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0 Image coding and decoding device. 



® In an image coding and decoding device, input digital image signals are divided into blocks of prescribed 
imifr.'^lf?.°?"?- is performed to differential signal taken between the input block signal and 

tnterframe forcasting signal thereby transmission recording is performed 

FIG. 1 
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IMAGE CODING AND DECODING DEVICE 



BACKGROUND OF THE INVENTION 



Field of the Invention 



The present invention relates to an image coding and decoding device, and nr^ore particularly to an 
image coding and decoding device which can efficiently code and decode the motion image signals so as 
10 to transmit and record the signals by the interframe coding. 

Description of the Prior Art 

75 

FIG. 3 is a block diagram which shows a transmitting section of an image coding transmitter in the prior 
art. In FIG. 3. numeral 2 designates a motion compensating circuit, numeral 6 designates a differential 
section, numeral 8 designates a coding and decoding circuit, numeral 11 designates an adder, and numeral 
13 designates a frame memory. 
20 FIG. 4 is a block diagram which shows a motion vector detecting section in the motion compensating 
circuit 2, In FIG. 4. numeral 14 designates a differential section, numeral 16 designates a distortion operator, 
and numeral 18 designates a comparator 

The operation of the device will be described. 

In the motion cpnnpensating circuit 2. using digitally transformed input signals 1 and previous frame 
25 reconstruction signals 3 stored in the frame memory 13. with the picture element blocks of the prescribed 
size Ni X Na (Nt. N2 being plus integers) used as a unit, a block which has the most similar pattern to the 
block of the input signal is detected from the previous signals, and signals of the detected block are 
ouputted as predicting signals 4. and index information 5 indicating motion vectors being position shift 
between the position of the block and that of the input signal block is transmitted to the receiving side. 
30 An example of the motion detecting method is shown in FIG. 4. 

Assuming that the input signal block be S(1). the previous frame signal block be Sj (3). the nunnber of 

the 

searched blocks be L (L being plus integer), the matching distortion between the blocks be di (17). and K 
= Ni X N2. 



S = (Si Sk). Sj = (S ii S ik)* 

K 

d. = E is. - S'^.| i = 1 - L 

^ i=l 3 ^3 

Among di(li) estimated by the differential section 17 and the distortion operator 16 based on the above 
formulas, the block having the smallest matching distortion value is detected by the comparator 18, and the 
block signal is transformed into the predicting signal 4 block by block, and the index information 5 of the 
block motion vectors is outputted. However, in FIG. 4. the hardware composition is simplified by applying 
the serial process to the distortion operation and the comparing process at each searching block. In FIG. 5, 
an example of the arrangement of the searching vectors is shown. 

Differences between the predicting signals 4 estimated as above described and the input signals 1 are 
taken, and the differential signals 7 are coded by the coding and decoding circuit 8, and then the coded 
information 9 is transmitted to the receiving side and at the same time the differential decoded signals 10 
by decoding the coded information and the predicting signals 4 are added thereby the reconstructed 
signals 12 are obtained. After one frame of these reconstructed signals 12 are stored in the frame memory 
13. they are read out as the previous frame reconstructed signals 3 at the next coding. 

In the coding and decoding circuit 8, coding is executed only when the value of the differential signals 7 
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is larger than a prescribed threshold value, and the picture element supplementing (the value of the 

the changtng of scenes, the matching precision between frames is low and the res3' ^io"t !f !h 
progSvJVlSuV Z^f'?'^.' ""'"3 section of me convenOonal Image signal 

the cX1ec«r rumLTarisTdeionir' ^^J^^^''^^*- ^'^^ <^-^-9 output signals obtained in 

R'<(x e R^) shall be m\rt^ v - u, J T^l ^' °' K-dimensional Euclid signal space 



50 



1 K 



= i4- I (S. - u>2,l/2 



55 



it = (Si -U)/a 

5 {Xt. X2 Xk} 
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Where as the approximate formulas of the amplitude a, following formulas can be used. 

o = E Is - Ul 

a = max Si -min St 

The scalar quantization of the average value u and the amplitude o, and the vector quantization of the 
average value separate input vectors x can make the generality of the vector quantizer with the limited 
number of output vectors much wider so as to develop its coding performance. 

The operation of the image signal progressive build-up decoder in the prior art will be described. In 
FIG. 10. at the first stage of coding, the frame memory 120 which stores the prestage decoded results is 
left cleared, and the input signal vectors 101 pass through the subtracter 102 as they are, and the average 
value separated and normalized vector quantization is performed as the residual signal vectors 103 in the 
average value separated and normalized vector quantizer 128, thereby the coding data 110 of the average 
value, the coding data 129 of the amplitude, the coding data 130 of the output vector index, and the residual 
signal decoded vectors 117 are outputted. Each of the coded data 110. 129. 130 Is converted into the 
suitable code words by the code assignment circuit 1 1 4 and then transmitted. The residual signal decoded 
vectors 117 pass through the adder 118, as they are, and are written as the decoded vectors 119 to the 
frame memory 120. At the second coding stage, in the subtracter 102 the residual signal vectors 103 are 
obtained by subtracting the previous stage decoded vectors from the input signal vectors lOl. The residual 
signal vectors 103 are quantized into the average value separated and normalized vectors in the average 
value separated and normalized quantizer 128, thereby the coding data 110 of the average value, the coded 
data 129 of the amplitude, the coded data 130 of the output vector index, and the residual signal decoded 
vectors 117 are outputted. Each of the coded data 110. 129, 130 is converted into the suitable code words 
in the code assignment circuit 114 and then transmitted. The residual signal decoded vectors 117 are 
added to the front stage decoded vectors in the adder 118 so as to renew the frame memory 120 as the 
decoded vectors 1 19. These processes are followed by the same coding operations repeated at each stage 
so as to transmit each of the coded data 113. 129. 130. resulting in renewing the frame memory 120. 

In FIG. 11. when the decoding starts, the frame memory 120 which stores the previous stage decoded 
results is left cleared. The coding device output signals 115 obtained in the coding section are inversed with 
respect to the code assignment in the code assignment circuit 124 so as to produce each of the coded data 
110. 129, 130, Each of the coded data 110. 129, 130 is inputted into the average separated and normalized 
vector quantization decoder 131. where the residual signal decoded vectors are obtained from the decoded 
average value and the amplitude reconstructed vectors. In the adder 118, the residual signal decoded 
vectors 117 are added to the front stage decoded results of the frame memory 120 so as to renew the 
frame memory 120. These operations are repeated at each stage. Since the image signal progressive 
reconstruction coding device in the prior art is composed as above described, it is difficult to control the 
amount of the coded information generation and the reconstructed image quality suitably in wider range. 

FIG. 16 is a block diagram which shows a composition example of a transmission section of an 
interframe coding device disclosed, for example, in the Technical Report of the Institute of Electronics and 
Communication Engineers of Japan IE84-1 ('84). In FIG. 11, numeral 201 designates the digitalized motion 
image signal system, numeral 207 designates a subtracter for obtaining the interframe differential signals, 
numeral 208 designates the interframe predicting signals formed from the past time frame which already 
finished coding, numeral 209 designates the Interframe differential signal system, numeral 210 designates a 
block discrimination section which quantizes the interframe differential signals 209 of the predicting error to 
naught, and discriminates block by block whether the coding at the next stage needs or not. numeral 21 1 
designates the threshold value for the block discrimination, numeral 212 a coding control section which 
decides the threshold value 211, numeral 213 designates a coding and decoding section which encodes 
and decodes the blocks judges as the significant predicting errors (they are called as the significant blocks 
or the blocks whose predicting errors are regarded as naught are called ineffective blocks) in the block 
discriminating section 210, numeral 214 designates the decoded predicting error signals obtained in the 
coding and decoding section 213, numeral 215 designates an adder which adds the predicting signals 208 
to the decoded predicting error signals 214. numeral 216 designates the decoding image signal system, 
numeral 217 designates a frame memory which forms the interframe predicting signals 208 using the 
decoded image signal series 216, numeral 218 designates the coded data obtained in the coding and 
decoding section 213. numeral 219 designates a variable length coding section which encodes the coded 
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data 218 in variable length, numeral 220 designates a buffer for smoothing where the variable length coding 
data system processes in the variable length coding section 219 is transmitted at the constant transmitting 
speed numeral 221 designates the data that count the variable length coding data system per frame (the 
amount of the generated information per frame), numeral 222 designates a line interface (l/F) section for 
5 transmitting the smoothed data system by the buffer 220 into the transmission line, and numeral 223 
designates the transmission signals. FIG. 17 is a block diagram showing a composition example of the 

Z^ZI: ? oT. °" designates a register for delaying the 

threshold value 211 in frame period, numeral 233 designates the threshold value delayed by the register 

,„ S T ""T'^ 234 designates a table ROM. FIG. 18 is a diagram which explains the characteristics to 
TO be written in the table RAM 234. 

The operation of the device will be described. The digitalized image signal system 201 is converted into 
the interframe differential signals 209 through the subtraction between the interframe predicting signal 208 
by the subtracter 207. The interframe predicting signals 208 are formed using the reconstruction image 
signal system of the past time frame which has finished coding and local decoding in the transmission 
section therein some other methods like the motion compensation are sometimes applied. The interframe 
differential signals 209 come near to naught in the case of no change or movement in a subject and the 
block discrimination section 210 discriminates the significant blocks or the insignificant blocks so as to 
transmit on y the data making the insignificant blocks recognized as they are. resulting in compressing the 
amount of the mfornnation. In order to discriminate blocks, the sum of the absolute value of the blocked 
interframe differential signal system is found and compared with the threshold value 211. Let the blocked 

interframe differential signal system by 0 = 1. 2 k) and the threshold value be T„. then the 

discrimination of the blocks Is executed as follows- men ine 



IS 



20 



25 



if 



^ l^il i T then insignificant block 



30 



K"-"- Z je I > T significant block 



L f H ^'"J:"' '^"^'"''^'^ ^ Significant, the interframe differential signals 209 are 

« t?^ J? «, h'"^ Ti '^'^'^ blocks and then decodes them so 

«L I s''9"3's 214 and the coded data 218. There are various coding 

omitted ht« TH H • '"V^^V^.^^.^ "«'^ ^^'^*'°"^'^'P t° '"-^ntion and the detailed description shall be 
omitted here. The decoded predicting error signals 214 are added by the adder 215 to the interframe 

sSm"li«'^ f 'h^-'"..""/" '"^'^'"^ ""^9^ ^'9"^' 216. The decoding imagHgTal 

thfrvt f f H T '"l^^^""^ ""^ "^^^ f°^'"'"9 '^"^ Predicting Sgnals tn 

SIIn? I J° °" ""^"^ «='9"«d to the coded data 218 in the 

3ni JT corresponding to generation frequency of each data. The buffe 120 

sZi and cnuS?l'° k. T'"!' '""^^'^ "^'""^ ^'"^ ^^^^^^ ^» '^^"^tant transmitting 

. amount 221 oer ilme toTi'^* T^*" ''^'"^ '^'^ -^rmatioS 

4S amount 221 per frame to the coding control section 212. The line interface section 222 transmits the soeed 

smoothed vanable length coded data as the transmission signals 223 Into the transmlssion^inr 

The coding control section 212. referring to the table ROM 234 by using the threshold value 221 aiven 

the frame delay by the register 232 and the amount of information, outputs the new threshl vaL 2i 1 Let 

50 T , be B„., then the new threshold value T„ (211) is obtained as shown in FIG. 18. Between the threshold 
value and the information amount, there is a hyperbolic relation as shown in FIG. 18. tn FIG 18 there a e 
four cun/es written, which vary according to the width of the movement of a subject. When B^' , and T a e 
n^n^'^^Z"" '""'"^ "'^^"S the plural curves stored in thi table ROM 234 Th^n The 

point B- of the amount of information is looked for along the chosen curve. Where B' is the informat on 
inToritifn"; '° °Z^'T " '''^"•'^•^^ ^'"^ transmission speed. When the poin o the aZS of 
Til V^'''^" °" '^"^ «t the point is read as T^ 

In other words, according to the relation between the threshold value T„., of the frame which finishes 
the codmg and the infom,ation amount B„.,. the characteristic curve corresponding to tf^fa^ounrof moSon 
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is decided and controlled so as to obtain the necessary threshold value to attain the aimed information 
amount as the new threshold value !„ from the curve. 

Since the interframe coding device is constituted as above described, delay is always produced in 
controlling the threshold value for smoothing the amount of the information. Accordingly it is disadvanta- 
5 geous in that when the subject is transferred from the static state to the dynamic state of from the dynamic 
state to the static state, the extreme time lapse may be produced or the focusing of the picture quality is 
likely to delay. 

FIG- 23 is a block diagram showing a composition example of a transmission section of an image signal 
progressive reconstruction coding device in the prior art using the vector quantizer, which is disclosed, for 

JO example, in the Technical Report of the Institute of Electronics and Communication Engineers of Japan 
IT85-61 (1985) titling "Image High Performance Coding by Vector Quantization". 

In FIG. 23. numeral 301 designates the input signal vectors which block the input signal system of the 
static image data and so on by every sample m x n (m, n being natural numbers), numeral 302 designates 
a subtracter which obtains the residual signal vectors of the input signal vectors 301 and the previous stage 

75 decoded vectors 319 delayed by one frame, numeral 303 designates the residual signal vectors, numeral 
306 designates an average value coding and decoding device which finds the average value within block at 
each vector and gives the high performance coding and decoding to the average value and outputs the 
average value coded data 308 and the average value decoded value 309. numeral 307 designates a normal 
vector quantization coding and decoding device which converts the residual signal vector 303 into the 

20 normalized output vectors and the amplitude gain through the inner product vector quantizer and outputs 
the vector quantization coded data 310 and the amplitude reconstructed output vector 311. numeral 308 
designates the average value coded data, numeral 309 designates the average value decoded value, 
numeral 310 designates the vector quantization coded data, numeral 311 designates the amplitude 
reconstructed vector, numeral 312 designates a first adder which adds the average value decoded value to 

25 the amplitude reconstructed vector so as to find the residual signal decoded vector 315. numeral 315 
designates the residual signal decoded vector, numeral 316 designates a second added which adds the 
residual signal decoded vector 315 to the front stage decoded vector 319 delayed by one frame so as to 
obtain the decoded vector 317 at each stage, numeral 317 designates the decoded vector at each stage, 
numeral 318 designates a frame memory which delays the decoded vector by one frame, numeral 319 

30 designates the previous stage decoded vector outputted from the frame memory 318. numeral 320 
designates a coding assignment circuit which transforms the average value coding data 308 and the vector 
quantization data 310 into the coded words using the variable length coding and then outputs the coded 
words, and numeral 324 designates the coded output data. 

The operation of the device will be described. In FIG. 23. at the time of the first stage coding, the frame 

35 memory 318 is left cleared. The input signal vectors 301 are not all processed in the subtracter 302, but 
outputted as the residual signal vectors 303 as they are. In the normalized vector quantization coding 
device 307. the average value of the residual signal vectors 303 is estimated, and then the average value is 
subjected to the high performance coding using the DPCM coding method or the like so as to output the 
average value coded data 308 and the average value decoding value 309 locally decoded. On the other 

40 hand, with respect to the normal vector quantization, the residual signal vectors 303 are converted through 
the inner vector quantizer into the normalized output vectors and the amplitude gain, and the vector 
quantization coding data 310 and the amplitude reconstructed output vectors 311 are outputted. 

The operation principle of the inner product vector quantizer will be described referring to FIG. 24. In 
the inner produce vector quantizer, the average value separation and normalization is given, and a set of the 

45 normalized output vector yi arranged on the unit superspherical surface of the multidimensional signal 

space. Y = ^2 ^n] is used. That is. the normalized output vector satisfies the following conditions 

simultaneously. 



50 



ii^ii = I'll > ' = 



The input vector x to the inner product vector quantizer is converted through the operation process of 
55 the following formulas"into the normalized output vector yj which gives the maximum inner product value to 
the input vector x, and the maximum inner product value is given as the amplitude gain g of the input 
vector X. 

if l(x, yi) > l(x, ^i) for all t 
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K 

(I(x, ) = I (x.y )) 
^ j=l 3 ^3 



9 = Zi) = M IZilcosfl, = |x|cosfli 

The amplitude gain g found as the scalar quantity is encoded and decoded independently, and the 
coded data together with the index i of the normalized output vector y^ are outputted as the vector 
quan^zation coding data 310. At the same time, the normalized output vector y, is multiplied by the local 
decoding value g of the amplitude gain g thereby the amplitude reconstructed output vector yr (31 1) is 

ir = 3 • yi 

.h. TJ^^lT^.^ ''^'"^ ^""^ *® a'"P'it"de reconstructed output vector 311 are added in 

^^Zt I '^l'".^ "'^"^ 315 is obtained, and then the residual signal 

decoded vector 315 is added in the second adder 316 to the previous stage vector 319 delayed by one 
frame. The decoding vector 317 of each stage being output of the second adder 316 is written in the frame 
memory 318 and delayed by one frame. On the other hand, the average value coded data 308 JidT 

aSL^t '^""^''^ ^""^'^'^ respectively in the code 

fom ? transmitted as the coded output data 234. At the second stage and so 

ST'r^^ri.TT"'^ T'^ "^^"1 ^"P""*^-^ ^"^ ^^^^"^^-^ ^"other with respect to 

vertnrf f H '"P"' ^'9"^' t''^ P^^^'o^^ Stage decoded 

vectors 319 stored in the frame memory 318. uouuueu 

Since the image signal progressive reconstruction coding device is constituted as above described the 

Z T'"^ . ^'"^^^ ""^ ^'^^^ block size is made larger the operation 

sea e of the inner product vector quantizer becomes larger in proportion to the dimension number of he 
vector, and when the block size is made smaller it is difficult to decrease the amount of tS coded 
information at the first stage significantly. 

art nSr^iif ^« '""^ "^'^T"". ^ composition example of an interframe vector quantizer in the prior 

art dsciosed. for example, in Murakami et al. "The Vector Quantization Method Interframe Codina 
Simulation" in he draft 1175 of the annual meeting 1983 of the Institute of Electronics and CommunteS on 
Engineers of Japan. In FIG 28. numeral 401 designates the input image signal system. nume^S 4^2 
designates a subtracter which performs subtraction to the interframe predicting signals numera 403 

^umSaf Isr^J"*'^?"' '^"'"'"^ •^-'9-^- InterfrLe'Sff^^^renrjg^^^^^ 

numera 439 designates a vector quantization coding section, numeral 440 designates the coded da a 

Zrjifft^lnS '"T " ^"'"^'^^^^'^ ''^'^^'^ designates decoded inte': 

innals I^S al the ^ 417 designates an adder which adds the decoded interframe different 

signals 416 and the interframe predicting signals 403. numeral 418 designates the decoded image sianal 

system 418 and forms the interframe predicting signals 403. numeral 420 designates a variable length 
coding section, numeral 421 designates a buffer for smoothing the speed, numeral 422 threshold value 
numeral 423 designates a line interface (l/F). and numeral 424 designates transmission signals 
439 TFfr PQ^ n TfoTl ^ composition example of the vector quantization coding section 

So H \ ■ u designates an average value separation and normalization section numeral 

429 designates the normalized vectors, numeral 431 designates a code book which stlres the outou 
vectors numeral 432 designates the output vectors, numeral 433 designates a distor^on operL^n sectS^^ 
which finds distortion between the normalized vectors 429 and the output vectors 432 .JmeratlS 
designates the distortion found in the distortion operation section 433. numeral 437 designa es a m nLum 
distortion detecting section which detects the minimum value from the distortion ?36 numTa 430 
designates the average value and the amplitude which are separated by the average value sepaTat on and 
IT TiH ''?"°" ' discrimination section. nLeTa^22 des^^^^^^^^^ 

he threshold value used for discriminating the blocks, numeral 435 designates the block dLr!mfnation 

:urrr4ioriSe?.ens^^^^^ '""^ "'^^ - — ~ - 

fh. i^,*?^ .°' -^^^'^^ described. The interframe predicting signals 403 are subtracted from 

the input image signal system 401 by the subtracter 402. thereby the input image signal sysSm 401 
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converted into the interframe differential signals 404. Since the interframe differential signal has little power 
in comparison to the original signal, it can be encoded with little coding error. The interframe differential 
signal 404 is encoded in the vector quantization coding section 439 (the coding method is described 
afterwards). Then the threshold value 422 is used as a parameter. The coded data 440 encoded in the 

5 vector quantization coding section 439 is decoded in the vector quantization decoding section 441 thereby 
the decoding predicting differential signal 416 is obtained. The interframe predicting signal 403 and the 
decoded interframe differential signal 416 are added in the adder 417 thereby the decoding image signal 
system 418 Is obtained. The decoded image signal system 418 is stored temporarily in the frame memory 
419 and supplied with the frame delay thereby the interframe predicting signal is formed- On the other 

70 hand, the coded data 440 is subjected to variable length coding in the variable length coding section 420 
and stored temporarily in the buffer 421 and subjected to speed smoothing process, and then passes 
through the line interface 423 and outputted as the transmission signal 424. In the buffer 421, the threshold 
value 422 in proportion to the data storage amount subjected to variable length coding is outputted and 
given to the vector quantization coding section 439 so as to control the information amount. Control of the 

75 coding and the information amount in the vector quantization coding section 439 will be described. The 
input signals to be subjected to the vector quantization are the interframe differential signals 404. The 
signals 404 are blocked (vector) in the average value separation and normalization section 428. and 
subjected to the average value separating and normalizing process. If the blocked input signals are 
represented as S = [Si. Sa 8^]. the average value separating and normalizing process is expressed for 

20 example as follows: 



25 



35 



40 



45 



50 



average value ms m Ic""^ • Z S 



k 

Z 



-1 ^ 

amplitude g: g - ^ • £ |S. -m| 



average value separate normalization: 
Xj = (Sj -m)/g 

The normalized vectors X = [xi, X2 Xk] obtained as above described are separated from the scalar 

quantity being the average value and the amplitude, and therefore unified with respect to the probability 
distribution in comparison to the vectors S before the average value separation and normalization, resulting 
in the effect to improve the efficiency of the vector quantization as hereinafter described. The distortion 
between the normalized vector 429 and the output vector 432 read from the code book 431 is found in the 
distortion operation section 433. In the minimum distortion detecting section 437. the minimum value among 
the distortion 436 between the output vectors stored in the code book 433 and the input vectors 429 is 
detected, and the index number 438 of the output vector giving the minimum distortion Is outputted. This 
process is the vector quantization. This is expressed in formulas as follows: 
distortion d: 

k 

d(x, if.) = E |x. - y. J 
^ j = l J 

wherein = [yii.yia Vikl output vector The maximum inner product value Pmax is given as the correction 

amplitude 413 (hereinafter referred to as "g") which approximates x, namely the magnitude of the average 
value separated input vector x as shown in the following formulas. 



55 
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Pmax = P(X. X!) = |X| • M * COSfl, 

= (x| cosfli = g 

The correction amplitude g is subjected to the high efficient coding in the amplitude coding device 415. and 
converted into the amplitude coding data 418. In the coding data multiplier 420. the average value coding 
data 417. the amplitude coding data 418 and the index 419 are multiplied, and transmitted as the output 
data 421 for the coding device in accordance with the prescribed format. 

The decoding operation will be described. The output data 421 for the coding device are separated in 
the coding data multiplication separating section 422 into the average value coding data 417. the amplitude 
coding data 418 and the index 419 in accordance with the prescribed format. The average value coding 
data 417 are decoded through the average value decoding device 423. and converted into the average 

value decoding value 425 (hereinafter referred to as " v ")• Similarly Y = [y,, y, t^] represents 

the contents of the code book. 
vector quantization Q: Q(X) = 
wherein d(x, y,) < d(x. yn,7for m * i 

In this case, the coding process is the mapping from x to i. and the mapping from i to y, (reading-out of 
the code book) becomes the decoding process, i corresponds to the Index 438. The average value and the 
amplitude 430 are used together with the threshold value 422 to discriminate the blocks in the block 
discriminatmg section 434. When the threshold value 422 Is made Th. the block discrimination is expressed 
as follows: 

|m( s Th and g S Th insignificant block 
|m( > Th or g > Th significant block 

As for the insignificant block, the interframe differential signal of the block is treated as 0. Consequently the 
average value, the amplitude 430 and the index 438 need not be transmitted in this case. The coding data 
440 outputted from the vector quantization coding section 439 comprises the average value, the amplitude 
430, the block discrimination information 435 and the index 438. but since the block discrimination 
information 435 only is valid in the case of the insignificant block, the information generating amount can be 
controlled by the threshold value 422. 

Since the interframe vector quantizer in the prior art is constituted as above described, the control 
range of the information amount is samll. Consequently, if the information amount is suppressed to the 
minimum, the changed parts on the screen are left behind as the insignificant blocks, resulting in producing 
so-called "pin hole noise". ^ vuu^,»iy 

FIGS. 33 and 34 are block diagrams showing a composition example of a vector quantization coding 
devu:e and a decoding device using vector quantization technology in the prior art disclosed, for example 
>n Image High Efficiency Coding by the Vector Quantization" in the Technical Report of the Instituted of 
Electronics and Communication Engineers of Japan IT85-61 (1985). In FIG. 33. numeral 501 designates the 
.nput signal vectors, numeral 502 designates an average value separating circuit which separates the 
average value component within the vector from the input signal vectors, numeral 503 designates the 
dl^^nV r """"^'^ ^^"^ designates an average value coding section, numeral 505 

des gnates the average value separated input vectors, numeral 508 designates an inner product operation 
section which finds the inner product value of the average value separated input vector and the normalized 
output vectors as hereinafter described, numeral 507 designates a code book ROM which stores a plurality 
of normalized output vectors, numeral 508 designates the address signals, numeral 509 designates the 
normalized output vectors, numeral 510 designates an address counter, numeral 511 designates the inner 
product valve calculated in the inner product operation section 508. numeral 512 designates a maximum 
inner product detecting section which finds the maximum value among the plurality of inner product values, 
numera 513 designates the correction amplitude defined by the maximum inner product value, numeral 514 
f n nnf ? K L ! designates an amplitude coding device, numeral 516 designates 

numelTsif TV" "T'' the average value coding data. 

Z^ZLl ! y^T." f- r""*"^^ designates the index, numeral 520 

designates a coding data multiplexing section, and numeral 521 designates the coded output data 

In «ie composition example of the vector quantization decoding device in FIG. 34. numeral 522 
designates a coded data demultiplexing section, numeral 524 designates an amplitude decoding device 
numeral 528 designates a code book ROM, numeral 525 designates the average value decoded vilue 



10 



0 288 963 



numeral 526 designates the amplitude decoded value, and numeral 527 designates the decoded vector. 

The operation of the vector quantization coding will be described. The input vectors 501 (hereinafter 
referred to as "S") constituted by the input signal system blocked every k pieces (k indicates integer being 
2 or more) are processed in the average value separating circuit 502 according to the formulas shown 
downwards, and subjected to separation to the average value 503 (hereinafter referred to as "a") within the 
vectors therefrom and transformed into the average value separated input vectors 505 (hereinafter referred 
to as "X"). 

The input vector S, the average value u within the vector, and the average valOe separated input vector 
X are expressed as follows: 

S = [S,. Sj SO 



1 

k 



k 

Z 



(j = 1, 2, 



k) 



x, = Sj -u 

x = p<,.X2 xo 

The average value a is subjected to the higfi efficiency coding in the average value coding section 504. 
and converted into the average value coded data 527. The average value separated input vector X is 
inputted in the inner product operation section 506. and converted through the inner product vector 
quantization coding process as hereinafter described into the correction amplitude 513 as hereinafter 
described and the index 519 as hereinafter described. The average value separated input vector X is 
normalized with its magnitude 



1/2 



into a plurality of normalized input vectors X\ and N pieces (N being natural nunnber) of normalized output 

vectors 509 [hereinafter referred to as (i = 1 . 2 N)] formed according to the statistical property of the 

normalized input vectors )C are written In the code book ROM 507. When the average value separated Input 
vector X is Inputted in the inner product operation section 506, the address counter 510 is reset and starts 
the counter operation of the period N. Then the normalized output vectors on the address, which are 
indicated by the address signals 508 outputted from the address counter 510, are inputted sequentially from 
the code book ROM 507 Into the inner product operation section 506, and the inner product 511 (hereinafter 

referred to as P(x, i = 1. 2 N) between the average value separated input vector X and N pieces of 

the normalized output vectors is calculated according to the following formula, and then outputted. 

k 

P(x, jr.) = E ^^i^ii^ 



Among N pieces of the inner product P(x. ^j) obtained by the calculation, the maximum inner product value 
Pmax is detected in the maximum inner'^product detecting section 512. and then the address signals 508 
showing the address within the code book ROM 507 of the normalized output vector giving the maximum 
inner product value are taken in the index latch 516 at timing synchronized with the strobe signals 514. The 
taken-ln address signals 508 are the index 519 to discriminate the prescribed normalized output vectors ^i, 
and transmitted to the coding data normalization section 520. On the other hand, the maximum inner 
product value Pmax Is given as correction amplitude 513 (hereinafter referred to as "g") to simulate amount 
|x| of the average value separated input vector x as shown in the following formulas: 
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2I1/2 , 1 k 



Pmax = P(X. Xi) = |x| • Izil • COS«i 

= |x| cosflj = g 



'° 2i conSn fnTn "^"''^.^J^ '"^'^'^ *° '^^ ^'9h efficiency coding by the amplitude coding device 515 
value S^ed daa 5^^ nf' TJJ^' """'''^ '''' '""'"^'^-■"a 520.' he average 

a:';^erdiJgt^^^^^^^^ - - transmitted 

The decoding operation will be described. The coding device output data 521 are seoaraten in the 

- Ta^Slf Llllfr ^H^r ZliTTut "oded 

?hrS.nh ; "^ata 518 and the index 519. The average value coded data 517 are decoded 

^^r JnZ T''^H '^^^'^^ 523 and converted into the average value decoding valu^^^^^^ 

(hereinafter ref^^^^^^^^^ '^"J,'" the amplitude decoded valuJ 526 (hereinafter'reSred 0 

as g ) are outputted from the amplitude decoding device 524. From the code book ROM Si7 th« 

" SfHHr— - ^^^^^^^^ ^ 



25 



s - [ s^i. s a. .... Sk] 
1"= a-yii+S 



rnnt!iT«f vector quantizer in the prior art is constituted as above described, it is impossible that the 

may bi deterioJatti !o°l" '"""T '"'"^ '"''"^ '"''^'^ approximation of r?4Sed vector 

may be detenorated to the unusual input vectors with different properties 

luan^^L , H w"^^ "'^'"'"^ '°^* ^O'* ^^s-gnates a quantization coding device wWch gives ^he 



45 



SO 
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The operation of the device will be described. 

The inputted image signals 701 are written to the input buffer 601. The input buffer performs writing and 
5 reading by the unit of the image frame, but it has the composition of double buffer because reading may be 
performed during writing. 

The coded and decoded image signals 702 before the present image signals by one frame are 
outputted from the frame memory 603. In the interframe subtracter 602, the interframe differential signals 
703 are obtained by subtracting between the present image signals 701 ' read from the input buffer and the 
70 image signals 702. The interframe differential signals 703 are encoded by the quantization coding device 
804, and become the quantization coded signals 704. FIG. 37 shows an example of characteristics of the 
quantization coding device. The quantization coded signals 704 are inputted in the variable length coding 
device 707. and transformed into the variable length code 706 corresponding to the frequency of each 
coded signal. 

75 At the same time, the quantization coding signals 704 are inputted in the quantization decoding device 
605, and then are ouputted as the coded and decoded differential signals 705. FIG. 38 shows an example of 
characteristics of the quantization decoding device. 

The coded and decoded differential signals 705 are inputted together with the image signals 702 into 
the interframe adder 606. and become the coded and decoded image signals 702' and are written to the 

20 frame memory 603 for the coding to the next frame. 

On the other hand, the variable length codes 706 are inputted in the transmitting buffer 608. The 
transmitting buffer outputs the data in accordance with the requirement from the transmission line side after 
storing the variable length codes over the definite amount, and has the composition of double buffer (buffer 
#1. buffer #2) because writing and reading must be performed at the same time. The transmitting buffer 

25 control section 609 controls writing and reading of the transmitting buffer. For example, when the buffer #1 
is at writing operation and the buffer #2 is at reading operation, the transmitting buffer control section 609 
monitors the storage amount of the buffer #1 , and if the storage amount becomes more than the prescribed 
set value, the transmitting buffer control section 609 demands ceasing of output of the data to the input 
buffer 601. 

30 Receiving the demands, the input buffer 601 ceases the output of the data to the next stage. The 
transmitting buffer control section 609 detects the pause of the input data to the transmitting buffer 608. and 
ceases writing to the buffer #1 and makes the situation of waiting for reading. The buffer #2 during reading 
ceases reading if the residual amount becomes less than the prescribed set value, an it waits for the buffer 
#1 to be in the situation of waiting for reading. When the buffer #1 is in the situation of waiting for reading, 
35 the buffer #2 and the buffer #1 are read out continuously. The buffer #2 is in the situation of waiting for 
writing when the residual amount becomes zero. 

When the buffer #2 is in the situation of waiting for writing, the transmitting buffer control section 609 
demands to start the output of the data to the input buffer 608. 

In this process, before the buffer #1 gets in the situation of waiting for reading, there becomes the 
40 situation that the transmitting buffer 608 cannot output any data. 

The dummy data adding section 610 outputs the data with the dummy data added thereto so as to 
continue the transmission of the data to the transmission line without break while the transmitting buffer 608 
cannot output the data. 

The data with the dummy data added thereto are subjected to conversion of electric level in the 
45 transmission line interface section 61 1 so as to meet the characteristics of the transmission line, and then 

outputted to the transmission line. On the receiving side, the signals inputted through the transmission line 

are subjected to phase conversion of electric level in the transmission line interface section 612. and the 

dummy data added in the dummy data adding section 610 are cleared in the dummy separate section 613 

thereby only the data about the images are outputted. 
so The output is processed in the variable length decoding section 614 by the reverse treatment with 

respect to that in the variable length coding section 607. and then inputted in the form of the quantization 

coded signals 704 into the receiving buffer 615. 

The receiving buffer has the composition of double buffer, because writing and reading are performed 

at the same time. In the receiving buffer, the stored data are variable in amount so as to take matching with 
55 respect to time between the signal speed inputted from the transmission line side and the speed of the 

image decoding section at the rear stage. 

For example, if the processing speed of the image .decoding section at the next stage is low. the stored 

amount of the receiving buffer is increased. On the contrary, if the processing speed is high, the receiving 
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buffer acts at the small stored amount. 



SUMMARY OF THE INVENTION 



great movement oHhe imag^ ortrrn"ca\"e ^"^^^^^^^ °' ^"^^ -^'^^"^^ ^-"^^ °^ 

" <^orr^Jr^Z^TtlTo^:::^Z tl^ r''' r ^ ^^^-"^ "^^^'^^'^ ^'^'^^ communicate 
while To is comZfively ^rgr ^ "^'^ "^'^ '^^'^^ ^"^^'^ °" '«'=«-"9 side Is small 



« BRIEF DESCRIPTION OF THE DRAWINGS 



50 



SB 



embod^tt'onhetfntfJr'" °' ^ compensation circuit in a fi.t 

fIg ? i ! kS^I^^^T "'"^*''^""9 ^t®P^ °f P^cess of the motion compensation circuit in FIG 1- 
^ FIG. 3 .s a block d.agram of a transmitting section of an image cocSng transmit* Section In the prior 

fig" 5 !I ^n"?"" '""^^ composition of the motion compensation circuit in FIG 3- 

F a I s a bS'dt:l'Trcoi""''^ •'^^ compenSion I FiG." i 

decoding .evicetn^stoTd^rbo^irt^;^,^^^^^^^^^^ ''"^^ ''""^^-P -ding a^d 

FIG 8 is a di'™TT 'I'"'*^'""^ "^on-position of the decoding section in FIG. 6; 
PIQ. 8 IS a diagram illustrating inner product vector quantization; 
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FIG. 9 is a diagram illustrating transmitting sequence of coded output data in this embodiment: 

FIG. 10 is a block diagram of a coding section of an image signal progressive build-up coding and 

decoding device in the prior art: 

FIG. 1 1 is a block diagram illustrating composition of a decoding section in FIG. lO: 
5 FIG. 12 is a block diagram illustrating composition of a transmitting section of an interframe coding 

device in a third embodiment of the invention; 

FIG. 13 is a block diagram illustrating composition of the temporal filter in FIG. 12: 
FIG. 14 is a block diagram illustrating composition of the coding control section in FIG. 12: 
FIG. 15 is a diagram illustrating operation of coding control in this embodiment; 
70 FIG. 16 is a block diagram illustrating composition of the transmitting section of an interframe coding 

device in the prior art: 

FIG. 17 is a block diagram illustrating composition of the coding control section in FIG. 16; 

FIG. 18 is a diagram illustrating operation of coding control in the interframe coding device in FIG. 16: 

FIG. 19 is a block diagram illustrating composition of a transmitting section of an image signal 
15 progressive build-up coding device in a fourth embodiment of the invention: 

FIG. 20 is a diagram illustrating operation of the vector- subvector converter in FIG. 19: 

FIG. 21 is a diagram illustrating operation of the subvector/vector converter in FIG. 19; 

FIG. 22 is a diagram illustrating an example of control means of the coding control section in FIG. 19; 

FIG. 23 is a block diagram illustrating composition of a transmitting section of an image signal 
20 progressive build-up coding device in the prior art; 

FIG. 24 is a diagram illustrating operation principle of an inner product vector quantizer; 

FIG. 25 is a block diagram illustrating composition of an interframe vector quantization coding device 
in a fifth embodiment of the invention; 

FIG. 26 is a diagram illustrating relation between the first stage vector quantization and the second 
25 stage vector quantization in the interframe vector quantization coding device in FIG. 25; 

FIG. 27 is a block diagram illustrating composition of the first stage vector quantization coding 
section of the interframe vector quantization coding device; 

FIG. 28 is a block diagram illustrating composition of an interframe vector quantization coding device 
in the prior art: 

30 FIG. 29 is a block diagram illustrating composition of the vector quantization coding section in FIG. 

28; 

FIG. 30 is a block diagram illustrating composition of a coding section of a dynamic vector quantizer 
in a sixth embodiment of the invention: 

FIG. 31 is a block diagram illustrating composition of a decoding section of the diagram vector 
35 quantizer in FIG. 30; 

FIG. 32 is a block diagram illustrating composition of the dynamic code book in FIG. 30; 

FIG. 33 is a block diagram illustrating composition of coding section of a vector quantizer in the prior 

art: 

FIG- 34 is a block diagram illustrating composition of a decoding section in FIG. 33; 
40 FIG. 35 is a block diagram of image coding transmission system according to the invention; 

FIG. 36 is a block diagram of image coding transmission system in the prior art; 
FIG. 37 is a diagram illustrating an example of characteristics of the quantization coding device; 
FIG. 38 is a diagram illustrating an example of characteristics of the quantization decoding device; 

and 

45 FIG. 39 is a diagram illustrating operation state of the transmitting buffer. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



A first embodiment of the invention will be described referring to FIG. 1 - FIG. 2. 

In FIG. 1 , reference numeral 20 designates a quantizer which quantizes the average value of the input 
block signal, numeral 23 designates a block selector which changes and outputs a block where previous 
frame block signals and picture elements within the block are 0 (hereinafter referred to as "0 block") and an 
55 average value block, and numeral 25 designates an index selector which changes and outputs motion 
vector index and quantized level index. Numerals 1-18 are similar to the prior art. 
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The operation of the device will be described. 



10 



IS 



In RG. 1. the interblock matching distortion operation and the comparison operation finish in serial 
processing with (L + 2) tinries per one input block when the number of the searched vectors is made L (L 
being plus integer). An example of processing steps is shown in FIG. 2 

Let the input block signals 1 be S = {S,. Sk}. and let theVeference block signals 24 be s'-, = 

^ "2 S «} and the calculation algorithm of the matching distortion d, is similar to the prior art ~ 

In the first processing, the block selector 23 outputs "0" block. In this case, an output 17 of a distortion 
operator 16 is represented by following formula, and this value becomes the average value m of the input 
signal blocks. However, the matching distortion operation uses the luminance signals only. 

K 

m = I Is. - 0| 



=1 3 



20 



K 

= £ S. 



25 



The average value m is quantized in the quantizer 20. and the quantization average value m 22 is 
inputted in me block selector 23. On the other hand, the quantization index 21 indicating the quantized level 

h M /M f .^"^'^^^ ''^'"^ *° '"'^^^ 25. Let the number of the quantized level 

by M (M being plus integer), and the quantized index from (L+1) to (L + M) is assigned at each level 

In the^second processing, the block selector 23 outputs the average value block m having the quantized 
average m as value of each picture element within the block. The output 17 of the distortion operator 16 in 
this case is represented by following formula, and this value made do. 



30 



35 



K 



where 0 is given as the vector index of the average value block. 
In the third processing and so forth, the distortion operation and the comparison operation are the same 
as noted above. That is. the block selector 23 outputs the previous frame block one after another. 
matrNnn ofthe comparator 18 becomes the index of the block which gives the minimum 

^H^^^ H among (L+1) pieces from d, to d, of the matching distortion. In the case, the vector 
index con-esponding to each reference block is assigned as shown in FIG 2 

m iJlT.!.t!rHTH'^'^''*°; ~'"P^^to^ °"tP"t '"dex 19 is 0. i.e.. when the average value block 

S *® quani^zea index which newly indicates the quantized level of the quantized average value 

m (the value being from (Lh- 1) to (L + M)] is outputted as the vector index 5. In other cases, the vaSe of me 
comparator output index 1 9. as it is. is outputted as the vector index 5 

distortirEuclW ni"!.^'^^^ ^""^ represented as the interblock matching 

K ^ I "'^1'" P'^^® °^ '* '® P°=^*'® to '"-^^^^^^ priority of the specific 

reference block by giving weight to the matching distortion in each reference block 
A second embodiment of the invention will be described referring to FIG 6 - FIG 11 

^rh" Jmnif /"^"'S"^^^^ '"P"* ^'Qnal vectors which block the input image signal system at 
rnn«i f\ " ^"1: " ''^'"^ designates a subtracter which estimates residua 

signal vector between the input signal vectors and previous stage decoding vectors delayed by one fSne 

OWOFf oTeJ^T"" ''V"f"'' ^ switch Which contr'fs 

2?^^! '""^ ""^ "^^''"^'"S ^" ^^«'^9« «=oding and decoding 

« f^H ^«^tor quantization coding and decoding device according to control signals from 

LI^Th h ^"^'Snates a sample value coding and decoding device whS^^give^ 

Tl lT J^ VV^""'" '^^^^^"'^"^ '^"'""^ '^''"trolled accor^ng ,o controrsignalJ 

from the coding control section per each sample, numeral 106 designates an average value codinrand 
decoding device which finds the average value within the block per'each vector, and gtes colg and 



16 



0 288 963 



decoding to the average value in the prescribed coding mode controlled according to control signals from 
the coding control section, numeral 107 designates a normalized vector quantization coding and decoding 
device which gives the inner product vector quantization in the prescribed coding mode controlled 
according to control signals from the coding control per each vector, numeral 108 designates coded data of 

5 the sample value, numeral 109 designates decoded value of the sample value, numeral 110 designates 
coded data of the average value, numeral 1 1 1 designates decoded value of the average value, numeral 112 
designates coded data of the amplitude and the output vector index, numeral 113 designates output vectors 
subjected to amplitude reconstruction, numeral 114 designates a code assignment circuit which assigns 
codes to each coding data according to control signals from the coding control section, numeral 115 

70 designates output signals of the coding device, numeral 1 16 designates a vector reconstructed circuit which 
obtains residual signal decoded vectors In the prescribed operation according to control signals from the 
coding control section, numeral 117 designates residual signal decoded vectors, numeral 1 18 designates an 
adder which adds the residual signal decoding vectors and the previous stage decoding vectors delayed by 
one frame, numeral 119 designates decoded vectors, numeral 120 designates a frame memory which 

IS delays the decoded vector by one frame, numeral 121 designates a coding control section which generates 
control signals to control each coding mode of the switch, the sample value coding and decoding device, 
the average value coding and decoding device and the normalized vector quantization coding device 
corresponding to error between the input signal vector and the decoded vector and the number of coding 
stages, numeral 122 designates control signals from the coding control section, and numeral 123 des- 

20 ignates coding stage indicating signals representing the number of coding with the frame unit. 

In FIG. 7. numeral 124 designates a code assignment circuit which carries out the code assignment 
inversion according to control signals from the coding control section, numeral 125 designates a sample 
value decoding device which carries out the sample value decoding by the prescribed decoding mode 
controlled according to control signals from the coding control section per each sample, numeral 126 

25 designates an average value decoding device which carries out the average value decoding by the 
prescribed decoding mode controlling according to control signals from the coding control section, and 
numeral 127 designates a normalized vector quantization decoding device which carries out the vector 
quantization decoding by the prescribed decoding mode controlled according to control signals from coding 
control section. 

30 

The operation of the device will be described. 



35 In FIG. 6. in the previous stage coding, the frame memory 120 storing the previous stage decoding 
results remains cleared, and the input signals vectors 111, as they are. pass through the subtracter 102 and 
are outputted as the residual signal vectors 113. The switch 104 renders only the average value coding and 
decoding device 106 to ON-state according to the control signals 122 from the coding control section. In the 
average value coding and decoding device 106. the average value within the block is calculated per each 

40 vector, and subjected to coding and decoding in the coding mode controlled according to the control 
signals 122. and the coded data 110 of the average value and the decoded value 111 are outputted. The 
coded data 1 10 of the average value are transformed by the code assignment circuit 114 into suitable code 
words, and then transmitted together with the control signals 122 in sequence of the first stage transmission 
data shown in FIG. 9. The vector reconstruction circuit 116 outputs the residual signal decoded vectors 117 

45 and all m X n samples as the decoded value 111 of the average value according to the control signals 122 
from the coding control section. The residual signal decoded vectors 117 pass through the adder 118. and 
are written as decoded vectors 119 into the frame memory 120. At the second stage coding, In the 
subtracter 102. the residual signal vectors 103 by subtraction of the previous stage decoded vectors from 
the input signal vectors 101 are obtained. The switch 104 renders the average value coding and decoding 

so device 106 and the normalized vector quantization coding and decoding device 107 to ON-state according 
to the control signals 122 from the coding control section. In the average value coding and decoding device 
106. the average value within the block is calculated per each vector, and the coded data 110 of the 
average value and the decoded value 111 are outputted in the coding mode controlled according to the 
control signals 122. In the normalized vector quantization coding and decoding device 107, the inner 

55 product vector quantization is performed, and the coded data 112 of the amplitude and the output vector 
index and the output vector 113 regenerated in terms of the amplitude are outputted. 

The operation principle of the inner product vector quantization will be described referring to FIG. 8. 
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set Of Ts ""^^'9" ^^'"^ ^^P^^^«<'" normalization is given, and a 

sTgna pace y " fv v' 7 ' 'T'rf °" superspherical surface of the multidime^sTonal 

Sons sLulta"neSs.y': " '''' """^^'^^^ ^^P"* ^^'^ satisfies the following 

I , r 5 2IV2 ' K 



^. gives tne maximum inner product value to the inout « 

the max,mum inner product value is given as the amplitude g of the inpJt signal ^ecTx: 

'5 if |(x. ^i) > \(x. ^i) for all t 
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K 

j=i 3 ^3 



g = l(x. Yd = |x| l^ij COSflj = |X| COSflj 



normalized output vector y, is multiS 1^1?. i.nH H^ ^^ ^'^'^^'^ ^^"'^ ""^^^ 

reconstructed output vecto^; ^rTs oC^^^^ ''''' ^ ^"P"*"^^ ^ ^^^^^^ --P«t-<^- 



as 



40 



45 



so 



55 



^n^^~ZV:Xr^^^^^^ -sjgnment ci.uit 114 into suitable code words, 

shown in FIQ. 9. In the vector reconstmr nn f i ff sequence of the second stage transmission data 

n samples as tt^e decodeTvLuHl f of^ h^^^ \ '^'"^ ^""^"^^'^ "^^^'"9 all m x 

113 are added accSfng to the ontrol sigTa?^^^^^ T""'' reconstructed output vectors 

decoded vectors 1 17 areoutDuttedThP IS - iL ® "^^ residual 

the previous st^ge LcJiervecSs and^^^^^^ ^'^'^^^ ''^ 

memory 120. At the S staqe S^^^^ '^T'^ ''^ ^''^'^"Q result renew the frame 

102 in Similar manner rth?Lcond sLfcS:fa'k^^ '^"^ 

and decoding device 105 to ONltafe ™rH „ ?' J ^^'^ '^^^ ^^"^P'^ ^^'^^ coding 

in the sam^e vl ue coding anrdln j^^^^^^^^ '° ^'9"^'^ ^^2 from the coding control section 

executed per each sa^pHit^rn theTeSo? in °' ''^^ ^^"^^'^ ^^'"^ 

122. and the coded data 108 a? thri,mn.f > . ' ^ controlled according to the control signals 

108 Of thi sample value I'! ia^S^TeStt: cT" "'"^ ^« ^^^^ 

transmitted together wiJ. Z control^an 5? ass.gnment crcuit 1 1 4 into suitable code words, and 

FIG. 9. in thefeotrrrors^uctrcS^^^^^ ''^ '''^^ transmission data shown in 

section, the residual signal ScoL ;^^^^^^^^^ "^^''T '^^"^ ''^ '^"^'"^ 

sample values are outputted SrLTual sionll . T^^'^ '^"^ " P''^-^^^ °' t^^^ 

previous stage decoded vSore and he h^^^^ ''^^ ^® ^° ^l^® 

120. The same co^g op^r2j.n as^^ T''' ''^ ^"'^'"^ ^^"^^ '^^^ ^^me memory 

the rorSgrdrdrd%rt?e^^^^^^^^^^ rctd^ r--" — stonng 

rn^r-crc^r^^^ir;^^^^^^^^ 

according to the prScrlbef modf Scordino^^^^ 'ff''''' "^"^^ °* '^«'=°'^^rs ^25, 126. 127 
the coding section, and theroutDut^ed ^s L transmitted at the same time from 

then outputted as the residual signals decoding vectors 117 from the vector 
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reconstruction circuit 116. The residual signal decoded vectors 117 are added to the previous stage 
decoded results in the adder 1 18 so as to renew the frame nnemory 120. 

In the coding control section 121, the average of the error between the input signal vector 101 and the 
decoded vector 119 in each stage is estimated in one frame period, and in accordance with the average 
5 error and the coded stage indicating signals 123. the control signals 122 for feedback control of changing of 
the switch 104 and changing of the average value coding mode, the normalized vector quantization coding 
mode and the sample value coding mode in the next stage coding are generated and outputted. 

Let the input signal vector be S and the decoded vector be s . then the error e may be defined, for 
example, by the following formula: 

to 




15 

In this embodiment, although the average of the error between the input signal vector 101 and the 
decoded vector 119 in one frame period is used in the coding control section 121 and the feedback control 
is executed, the error between the residual signal vector 103 and the residual signal decoded vector 117 
may be used, and in place of the average of the error in one frame period, the amount of all coded 

20 information of one frame period may be used so as to obtain the same effect as the embodiment, 

FIG. 12 is a block diagram illustrating composition of a transmitting section of an interframe coding 
device in a third embodiment of the invention. In FIG. 12. numeral 201 designates a digitalized motion 
image signal system, numeral 202 designates a temporal filter, numeral 203 designates interframe 
differential signals obtained in the temporal filter 202 and subjected to the non-linear weighting, numeral 204 

25 designates a motion amount estimation section, numeral 205 designates estimated motion amount obtained 
in the motion amount estimation section 204. numeral 206 designates motion image signal system which is 
processed by the temporal filter 202 and subjected to conversion of the resolving power or the speed, 
numeral 207 designates a subtracter for obtaining interframe differential signals, numeral 208 designates 
interframe predicting signals formed from the past-time frame after finishing the coding already, numeral 

30 209 designates interframe differentia! signal series, numeral 210 designates a block discrimination section 
which quantizes the interframe differential signals 209 being the predicting error as zero, and discriminates 
whether the coding processing at the next stage must be performed or not block by block unit, numeral 21 1 
designates threshold value for the block discrimination, numeral 212 designates a coding control section 
which determines the threshold value, numeral 213 designates a coding and decoding section which 

35 encodes and decodes a block discriminated to have the significant predicting error in the block discrimina- 
tion section 210. i.e., significant block, numeral 214 designates decoded predicting error signals obtained in 
the coding and decoding section 213. numeral 215 designates an adder which adds the predicting signals 
208 and the decoded predicting error signals 214, numeral 216 designates decoded image signals, numeral 
217 designates a frame memory which forms the interframe predicting signals 208 using the decoded 

40 image signals 216, numeral 218 designates coded data obtained in the coding and decoding section 213. 
numeral 219 designates a variable length coding section which gives the variable length coding to the 
coded data 218, numeral 220 designates a buffer where the data series subjected to the variable length 
coding in the variable length coding section 219 is transmitted at the definite transmission speed, numeral 
221 designates data by counting the variable length coded data per each frame (information amount per 

45 frame), numeral 222 designates a line interface where the data system smoothed in the buffer 220 is 
transmitted to the transmission line, and numeral 223 designates transmitting signals. FIG. 13 is a block 
diagram illustrating composition of the temporal filter 202 in FIG. 12. 

In FIG. 13, numeral 224 designates a subtracter which finds difference between frames, numeral 225 
designates ima!ge signals of the past-time frame, numeral 226 designates interframe differential signals. 

50 numeral 227 designates a non-linear .weighting circuit which provides weight to the interframe differential 
signals 226, numeral 228 designates an adder which adds the interframe differential signals 203 weighted 
and the image signals 225 of the past-time frame, numeral 229 designates temporaj filter output signals 
obtained by the adder 228, and numeral 230 designates a frame memory which performs frame delay, 
resolving power conversion or speed conversion. 

55 FIG. 14 is a block diagram illustrating composition of the coding control section 212 in FIG. 12. In FIG. 
14. numeral 231 designates a table ROM. numeral 232 designates a register which delays the threshold 
value 21 1 at the frame period, and numeral 233 designates threshold value delayed by the register 232. 
FIG. 15 is a diagram illustrating characteristics to be written in the table ROM 231. 
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The operation of the device will be described. The digitalized image signals system 201 is first inputted 
to the temporal filter 202. In the temporal filter 202, subtraction to the previous frame signal 225 is 
performed by the subtracter 224 and the output is converted into the interframe differential signal 226. The 
interframe differential signal 226 is made the weighted signal 203 by the non-linear weighting circuit 227, 

5 and added to the previous frame signal 225 by the adder 228 into signal 229 subjected to the temporal filter 
processing. The signal 229 is stored in the frame memory 230, and used in the filter processing of next 
frame. The frame memory 230 not only gives the frame delay for the temporal filter, but also has function of 
converting the resolving power or the speed to meet the specification of the coding section or the 
transmission speed and reading it as the coding input image signals 206. When the transmission speed is 

10 low, the coding frames are thinned out. i.e., so-called frame cutting is performed. Then only the frames for 
coding are read from the frame memory 230. and other frames removed by the frame cutting are 
overwritten on the memory. Consequently, the time relation between the image signal series 201 and the 
previous frame signal 225 becomes relation of "frames which are encoded continuously". The weighted 
interframe differential signal 203 is integrated by one frame In the motion amount estimation section 204, 

15 and used as the estimated motion amount 205 for determining the threshold value as hereinafter described. 
The signal 206 read from the frame memory 230 is subjected to subtraction to the interframe predicting 
signal 208 by the subtracter 207. and converted into the interframe differentia! signal 209. The Interframe 
predicting signal 208 is formed using the reconstruction Image signals of the past-time frame after finishing 
the coding and the local decoding in the transmitting section already, and method of the motion 

20 compensation or the like may be used in this case. Since the interframe differential signal 209 gets quite 
close to 0 when the subject has no variation or motion, the significant block and the insignificant block are 
discriminated in the block discrimination section 210 as above described, and regarding the insignificant 
block the data Indicating it as insignificant only are transmitted thereby the information amount can be 
compressed. In order to discriminate blocks, the absolute value sum of the interframe differential signal 

25 system formed in blocks is estimated, and then compared with the threshold value 21 1 . Let the interframe 
differential signal series in blocks be Q = 1,2, k). and the threshold value be Tn. then the block 
discrimination is performed as follows: 



if k" £ l^al < insignificant block 



if k"-^ Z |e. I >T significant block 

j=l ^ ^ 



Regarding the block discriminated as a significant block, further the interframe differential signal 209 is 
encoded. In the coding and decoding section 213. the significant block is encoded and then decoded, and 
the decoded predicting error signal 204 and the coded data 218 are outputted. There are various sorts of 
the coding and decoding methods. However, since these have no direct relation to the essence of the 
invention, the detailed description shall be omitted here. The decoding predicting error signal 214 Is added 
to the interframe predicting signal 208 by the adder 215 so that the decoded image signals 216*is formed. 
The decoding image signals 216 are stored in the frame memory 217. and used to form the interframe 
predicting signal in the next frame and so forth. On the other hand, the coded data 218 is assigned with 
code words corresponding to the frequency of each data in the variable length coding section 219. In the 
buffer 220. the speed is smoothed so that the coded data series subjected to the variable length coding is 
transmitted at the constant transmission speed and the coded data series in variable length coding is 
counted per each frame and outputted as the information amount 221 per frame to the coding control 
section 212. The line interface 222 transmits the variable length coded data with speed smoothed as the 
transmitting signals 223 to the transmission line. 

In the coding control section 212. using the estimated motion amount 205. the information amount 221 
and the threshold value 233 supplied with the frame delay by the register 232 and referring to the table 
ROM 234. the new threshold value 21 1 is transmitted. Let the estimated motion amount 205 be Mn. the past 
threshold value 233 be T„.i, and the information amount 221 in the frame coded using T„., be Bn.i. then the 
new threshold value Tn (21 1) is obtained as shown in FIG. 15. 
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Between the threshold value and the information amount, there is hyperbolic relation as shown by four 
curves in FIG. 15. The four characteristic curves show an example, and vary depending on whether the 
motion of the subject is large or small. Rrst. from Bn., and Tp-i. one characteristic curve is selected among 
a plurality of curves stored in the table ROM 231. The characteristic curve indicates what degree of the 
motion is included in the frame which is encoded using the threshold value T„., and generates the 
information of B„.i. Since the estimated motion amount Mn (205) estimates the motion amount of the frame 
to be encoded hereafter, the motion characteristic curve is suitably transferred using Mn. If Mn is large, the 
curve is transferred to the characteristics with large motion; if Mn is small, the curve is transferred to that 
with small motion. Subsequently the point with the information amount being 8' is searched along the 
determined curve. In this case. B" is the information amount allowed per one frame corresponding to the 
transmission speed. If the point with the information amount being 8" is determined on the selected curve, 
the threshold value on the point is read as Tn. That is. the characteristic cun/e corresponding to the motion 
amount is selected from relation between the threshold value Tn.i of the frame after finishing the coding and 
the information amount Bn.i. Regarding the frame to be coded • hereafter, the characteristic curve is 
corrected using the estimated motion amount, and control is performed so that ttie threshold value required 
to attain the intended information amount is obtained as the new threshold value T„ from the curve. 

In this embodiment, although the temporal filter processing or the frame delay by the frame memory 
230 to convert the resolving power and the speed is used as means for obtaining the interframe differential 
signal 203 being the reference signals to estimate the motion amount, of course, the frame memory may be 
prepared only for estimating the motion amount. 

A fourth embodiment of the invention will be described referring to FIG. 19 - FIG. 22. FIG. i9 is a block 
diagram illustrating composition of a transmitting section of an image signal progressive build-up coding 
device in the fourth embodiment of the invention. In FIG. 19. numeral 304 designates a vector/subvector 
converter which reduces the dimension number of the input vector from L (= am x bn). (a. b. m. n being 
natural number) into K (= m x n) and forms subvector, numeral 314 designates a subvector/vector 
converter which uses a sample value within the subvector of the dimension number K ( = m x n) and forms 
the vector of the dimension number L (= am x bn) in interpolation reconstruction, numeral 305 designates 
residual signal subvector. numeral 313 designates residual signals decoding subvector. numeral 322 
designates a coding control section which produces control signals 323 indicating parameters a, b. m. n to 
determine the dimension number L and K of the vectors and the threshold value corresponding to coded 
stage number 321, and numeral 325 designates discrimination information which Indicates whether the 
coding and decoding to the residual signal vector 303 should be executed or not. Other numerals 301 - 303, 
306 - 312, 314 - 320. 324 are similar to those in the device to the prior art. 

The operation of the device will be described. In FIG. 19. at first stage coding, the frame memory 318 
remains cleared. The input signal vector 301 of the dimension number L = (am x bn) is not subjected to 
any processing in the subtracter, but outputted as it is as the residual signal vector 303. The residual signal 
vector 303 is inputted to the vector/subvector converter 304. and subjected to the conversion processing of 
the dimension number as hereinafter described and converted into the residual signal subvector 305 of the 
dimension K (= m x n) and then outputted. In the vector/subvector converter 304, the residual signal vector 
303 and the residual signal subvector 305 are represented respectively as follows: 

input vector: s = [si. S2. .... s, sj : re{1. 2. .... L} 

subvector ; u = (Ui. ua. ... Uj. .... Uk] : je {1, 2. .... K} 

The sample value uj in the subvector is given by value of samples in the input vector averaged per a x b 
samples as shown in the following formulas: 

= (j - 1) X a • b + L 



^ r-, - j X a • b 



FIG. 20 shows relation between the input vector and the subvector when a = b = m= n= 4 



21 



0 288 963 



corresponding to the innage signal system of two dimension. 

The residual signal subvector 305 is inputted to the average value coding device 306 and the 
normalized vector quantization coding device 307. and subjected to the same processing as that of the prior 
art. As a result, the average value coded data 308 and the average value decoded value 309 are outputted 
from the average value coding device 306. and the vector quantization coded data 310 and the amplitude 
constructed output vector 31 1 are ouputted from the normalized vector quantization coding and decoding 
device 307, and the average value decoded value 309 and the amplitude reconstructed output vector 311 
are added in the first adder 312. thereby the residual signal decoded subvector 313 is obtained. The 
residual signal decoded subvector 313 of K dimensions is subjected to the following processing through the 
subvector/vector converter 314, and converted into the residual signal decoded vector 315 of L dimensions. 
In the subvector/vector converter 314. the residual signal decoded subvector 313 and the residual signal 
decoded vector 31^5 are represented respectively as follows: 

subvector ; u = [ut^ua^..., u,-.^,... ukU ]e{1.2 K} 

output vector; s = [si . Sa s^ .... sj : re{1 , 2 L} 

The sample Sr in the output vector is given in that the same samples In the subvector are arranged 
repeatedly per a x b samples as shown in the following formulas: 

'S^ = : r6{l, 2, . • . , L}. 

j = INT (r - 1) /a*b +1: INT ( • ) represents conversion to 

integer by emission of 
fractions 



FIG. 21 shows the sample arrangement in two dimensions of the subvector corresponding to samples in 
the output vector when a = b = m = n = 4. 

The residual signal decoded vector 315 is added in the second adder to the previous stage decoding 
vector 319 delayed by one frame in similar manner to the device in the prior art, and written as the 
decoding vector 317 in the frame memory 318 and used for the coding in the next stage. The average 
value coded data 318 and the vector quantization coded data 310 are supplied to the code assignment 
circuit 320. 

At the second stage and so forth, to the residual signal vector 303 between the input signal vector 301 
and the previous stage decoding vector 319 stored in the frame memory 318. the above-mentioned coding 
processing is executed in sequence repeatedly under following control; 

The coding control section 322 produces the parameters a. b, m. n to determine the dimension number 
of each of the residual signal vector 303. the residual signal subvector 305. the residual signal decoded 
subvector 313. the residual signal decoded vector 315 in the coding processing and the control signal 323 
indicating the threshold value as hereinafter described corresponding to the coded stage number 321 . and 
supplies the control signals 323 to the vector/subvector converter 304. the subvector/vector converter 314 
and the code assignment circuit 320. FIG. 22 shows an example of setting method of the dimension number 
L (=: am X bn) of the residual signal vector 303 at the first stage and the second stage corresponding to the 
image signal system of two dimensions. At the second stage coding processing and so forth, the 
vector/subvector converter 304 compares the average square value per sample within the residual signal 
vector 303 with the threshold value supplied from the coding control section 322 in magnitude. As a result 
of comparison, if the average square value is larger than the threshold value, the coding and decoding 
processing is executed. If not. the coding and decoding, processing is not performed, but all sample values 
within the residual signal decoded vector 315 outputted from the subvector/vector converter 314 is made 0. 
The discrimination information 325 indicating result of the magnitude comparison is supplied from the 
vector/subvector converter 304 to the code assignment circuit 320 and the subvector/vector converter 314. 

In the code assignment circuit 320. the control signal 323, the discrimination information 325. the 
average value coded data 308 and the vector quantization coded data 310 are converted into suitable code 
words, and then transmitted as the coding output data 324, 

In this embodiment, although a plurality of samples of the input vector are combined and averaged and 
made samples of the subvector in the operation of the vector/ subvector converter, samples within the input 
vector may be extracted according to suitable subsample pattern and made samples of the subvector. and 
further a smoothing filter for the band limiting may be inserted in the input stage. 
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A fifth embodiment of the invention will be described referring to FIG. 24 - FIG. 28. FIG. 25 is a block 
diagram illustrating composition of a coding section of an interframe vector quantization device. In FIG. 25. 
numeral 401 designates input image signal system, numeral 402 designates a subtracter which performs 
subtraction to interframe predicting signals, numeral 403 designates interframe predicting signals, numeral 

5 404 designates interframe differential signals, numeral 405 designates a first stage vector quantization 
coding section, numeral 406 designates first stage coding data, numeral 407 designates a first stage vector 
quantization decoding section, numeral 408 designates first stage decoding signals, numeral 409 designates 
a subtracter which finds difference between the interframe differential signals 404 and the first stage 
decoded signals 408. numeral 410 designates first stage error signals, numeral 412 designates a second 

to stage vector quantization coding section, numeral 412 designates second stage coded data, numeral 413 
designates a second stage vector quantization decoding section, numeral 414 designates second stage 
decoded signals, numeral 415 designates an adder which adds the first stage decoded signals 408 and the 
second stage decoded signals 414, numeral 416 designates decoding interframe differential signals, 
numeral 417 designates an adder which adds the interframe predicting signals 403 and the interframe 

75 differential signals 416, numeral 418 designates decoded image signal system, numeral 419 designates a 
frame memory which supplies the decoded image signal system 418 with the frame delay and forms the 
interframe predicting signals 403, numeral 420 designates a variable length decoding section, numeral 421 
designates a buffer for the speed smoothing, numeral 422 designates, threshoid value, numeral 423 
designates a line interface (IF), and numeral 424 designates transmitted signals, FIG. 26 is a diagram 

20 illustrating relation between the first stage vector quantization and the second stage vector quantization. 
FIG. 27 is a block diagram illustrating composition of the first stage vector quantization coding section 405 
in FIG. 25. In FIG, 27, numeral 425 designates an average value and amplitude operation section, numeral 
426 designates average value, numeral 427 designates average value and amplitude, numeral 428 
designates an average value separation and normalization section, numeral 430 designates average value 

25 and amplitude, numeral 429 designates normalized vectors, numeral 431 designates a code book which 
stores output vectors, numeral 432 designates output vectors, numeral 433 designates a distortion operation 
section which calculates distortion between the normalized vectors 429 and the output vectors 432, numeral 
422 designates threshold value, numeral 434 designates a block discrimination section, numeral 436 
designates distortion calculated in the distortion operation section 433. numeral 437 designates a minimum 

30 distortion detecting section which detects the minimum value of the distortion 436. numeral 435 designates 
block discrimination information, and numeral 438 designates index of the output vector giving the minimum 
distortion. 

The operation of the device will be described. The input image signal system 401 Is subjected 
subtraction of the interframe predicting signal 403 by the subtracter 402, and converted into the interframe 

35 differential signal 404. The interframe differential signal has little power in comparison to the original signal, 
and therefore can be encoded with little coding error. The interframe differential signal 404 is encoded in 
the first stage vector quantization coding section 405. Then the threshold value 422 is used as parameter. 
The coded data 406 encoded in the first stage vector quantization coding section 405 is decoded in the first 
stage vector quantization decoding section 407 thereby the first stage decoded signal 408 is obtained. The 

40 first stage decoded signal 408 is subtracted from the interframe differential signal 404 by the subtracter 409 
thereby the first stage error signal 410 is obtained. The first stage error signal 410 has little power further in 
comparison to the interframe differential signal 404, and therefore can be encoded with little coding error. 
The first stage error signal 410 is encoded in the second stage vector quantization coding section 411. 
Then the threshold value 422 is used as parameter. The coded data 412 encoded in the second stage 

4S vector quantization coding section 41 1 is decoded in the second stage vector quantization decoding section 
413 thereby the second stage decoded signal 414 is obtained. The first stage decoded signal 408 and the 
second stage decoded signal 414 are added in the adder 415 thereby the decoded interframe differential 
signal 416 is obtained. The interframe predicting signal 403 and the decoded interframe differential signal 
416 are added in the adder 417 thereby the decoded image signal series 418 is obtained. The decoded 

50 image signal series 418 is stored temporarily in the frame memory 419 and supplied with the frame delay 
thereby the interframe predicting signal is formed. On the other hand, the first stage coded data 406 and 
the second stage coded data 412 are subjected to the variable length ceding in the variable length ceding 
section 420. and stored temporarily in the buffer 421 and subjected to the speed smoothing processing, 
and then transmitted as the transmitting signal 424 through the line interface (l/F) 423. In the buffer 421 , the 

55 threshold value 422 in proportion to the storage amount of the variable length coded data is outputted, and 
supplied to the first stage vector quantization coding section 405 and the second stage vector quantization 
coding section 41 1 so as to control the information generation amount. 

Next, referring to FIG. 26 and FIG. 27. the operation of the first stage vector quantization coding section 
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406 and the second stage vector quantization coding section 411 will be described. As described regarding 
the interframe vector quantization device in the prior art, in the vector quantization, the picture element is 
made a plurality of blocks and the output vector with the highest similarity (least distortion) is searched. In 
FIG. 26, an example of the vector quantized in the first vector coding section 405 and the vector quantized 
in the second stage vector quantization coding section 41 1 is shown. The dimensions of the vector in any 
case are made 4x4 = 16. In the invention, the average value of interframe differential signals 
corresponding to the same position on the picture plane as that of the vector quantized at the second stage 
(formed by the first stage error signal) is made one element, and vector quantized at the first stage is 
formed. Consequently, as shown in FIG. 26, when the vector quantized at the first stage and the vector 
quantized at the second stage are overlaid on the picture plane, one piece at the first stage corresponds to 
16 pieces at the second stage. This is expressed by formulas as hereinafter described. If the series 
comprising the interframe differential signals 404 blocked per 4 x 4 = 16 pieces is represented as S,- = 

f^i'* Site], and set comprising the system Sj blocked further per 4 x 4 = 16 pieces on the picture 

plane is represented as tS] = [St, §2. .... Sis] (S| e [S], i = 1 - 16). FIG. 26 is expressed as follows: 

16 

block average value ; 1/16 I s. . (i - 1 16) 



vector quantized at first stage m = [mi, ma, .... mis] 

m and [S] = tSi . §2 Sis] are at the same position on the picture plane. 

If the first stage decoded signals 408 obtained at the first stage vector quantization decoding section 405 

and the first stage vector quantization section 407 are represented as m' = [m/. m2 m,s'], the first 

stage error signals 410 to be subjected to the vector quantization at the second stage are following vectors: 

Si -m/ • u = [Sii -m/, Si2 -m/, ... Sng -m/j 
(u: unit vector) 



At the second stage, the above-mentioned vectors are subjected to the average value separation and 
normalization, and then to the vector quantization as described regarding the interframe vector quantization 
device in the prior art. Consequently, influence of the first stage vector quantization to the second stage 
vector quantization relates only to the average value being the scalar quantity, and therein no influence as 
vector. If there Is any influence between both, efficiency of the vector quantization at the second stage is 
deteriorated by error of the vector quantization at the first stage. If relation between the first stage and the 
second stage exists only in the scalar quantity as in the case of the invention, the first stage vector 
quantization does not adversely affects the second stage vector quantization. 

FIG, 27 is a block diagram illustrating composition of the first stage vector quantization coding section 
405. Input signal to be subjected to the vector quantization is the interframe differential signal 404. The 
signal 404 calculates the average value and the amplitude in unit of a block of 4 x 4 = 16 pieces tn the 
operation section 425 of average value and amplitude. This block has amount of a block to be subjected to 
the vector quantization at the second stage. The obtained average value 426 is blocked, and the vector for 
the first stage quantization is formed and subjected to the average value separation and normalization in the 
average value separation and normalization section 428. This is expressed by formulas as hereinafter 
descnbed. The operation in the operation section 425 of average value and amplitude is to calculate 



16 



average value m. : m. = 1/16 Z s. . 

^ j=l 

16 

amplitude g : g = I/I6 Z |s.. - m.l 

^ j«l ^ 



The processing in the average value separation and normalization section 428 is to calculate 
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average value M : M 



= 1/16 



16 
£ 




amplitude 



G 



G 



= 1/16 



16 
Z 




average value separation and normalization : X| = (mj .. M)/G 

Distortion between the normalized vectors X = [xi, xz xis) obtained as above described and the output 

vectors 432 read from the code book is calculated in the distortion operation section 433, Before this 
processing, the average value mi and the anriplitude g-, (427) are compared with the threshold value 422 in 
the block discrimination section 434. Let the threshold value 422 be Th. the block discrimination is 
represented as follows: 

|mi| < Th and gi < Th insignificant block 
jmij > Th or gj > Th significant block 

Regarding the insignificant block, the coding is not required at the first stage and the second stage. 
However, since the block discrimination uses the block In the second vector quantization coding device 411 
as unit, it is only one element for the block of the first stage. Consequently, in the distortion operation 
section 433. the distortion of the element corresponding to the insignificant block is estimated as 0. That is. 
the distortion 436 is usually calculated as follows: 



However, if the block Si is insignificant block, since the corresponding element becomes Sj — mi X|, the 
distortion 436 is calculated as follows: 



In the minimum distortion detecting section 437. among the distortion 436 between the input vector stored 
in the code book 431 and the input vector 429. the minimum distortion is detected and the index number 
438 of the input vector giving the minimum distortion is outputted. The coded data 406 outputted from the 
first stage vector quantization coding section 405 are the block discrimination information 435, the average 
value M and the amplitude G (430), the index 438. However, if all blocks included in the blocks to be 
quantized at the first stage are insignificant blocks, since information other than the block discrimination 
information 435 does not have any meaning and need not be transmitted, the information amount can be 
controlled by the threshold value 422. 

Regarding the second stage vector quantization coding section 411. the operation is similar to that of 
the vector quantization coding section 439 described regarding the interframe vector quantization device in 
the prior art. In the embodiment, since the threshold value 422 supplied to the second vector quantization 
coding section 41 1 may be controlled and only the first stage vector quantization coding section 405 may 
be used for the coding, the information amount can be significantly controlled. 

In this embodiment, although the control of the threshold value is feedback control corresponding to the 
storage amount of the buffer, it is also effective that the frame memory is installed at the front stage of the 
coding device and the motion amount is estimated thereby factor of feedforward is added. 

Also in this embodiment, although the fixed output vector set is used in the vector quantization code 
book at both the first stage and the second stage, it is also effective that the code book for the first stage 
produces the output vector using frame memory content within the loop and the method of vector 



16 

distortion d : d(X, Y^) = I 



16 



j=l(j-i) 
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quantization or motion compensation is used. Merit in that the average value of the block to perform coding 
of the second stage is treated as the picture element in the first stage is not limited to the vector 
quantization, but, for example, use of the orthogonal transformation in coding of the second stage is also 
effective because higher harmonics are not generated due to error in the first stage. 

A sixth embodiment of the invention will be described referring to FIG. 30 - FIG. 32. In FIG. 30. numeral 
528 designates a dynamic code book RAM in which writing or reading is possible at any time, numeral 529 
designates a normalisation circuit which normalizes the average value separated input vector X in 
magnitude X of the vector, numeral 530 designates normalized coefficient hereinafter referred to as "a", 
and numeral 531 designates normalized input vector hereinafter referred to as "X'". Numeral 532 
designates a dynamic code book control section which controls the update procedure of the dynamic code 
book RAM. numeral 533 designates write demand signals, numeral 534 designates normalized input vector 
with index, numerals 535a. 535b designate selectors, and numeral 536 designates vector data. In FIG. 31. 
numeral 537 designates a vector data decoding section. 

The vector quantization coding operation in an embodiment of the invention will be described referring 
to FIG. 30. Input signal vector S designated by numeral 501 in FIG, 30 is converted by the average value 
separate circuit 502 into average value separated input vector X designated by numeral 505 in FIG. 30. and 
then inputted to the inner product operation section 506 and the normalization circuit 529. The average 
value is processed and transmitted in similar manner to the prior art. The inner product P (x. ^j) between 
the normalized output vector which is read from the fixed code book ROM 507 and the dynamic code 
book RAM 528 and designated by numeral 509 in FIG. 30 and the average value separated input vector x is 
calculated in the inner product operation section 506 in similar manner to the prior art. and then The 
normalized output vector giving the maximum inner product value to the average value separated input 
vector X is detected, and the address signal 508 indicating address of the detected normalized output 
vector j^i on the fixed code book ROM or the dynamic code book RAM is outputted as the index 519 from 
the index latch 516. The maximum inner product value P^ax is outputted as the correction amplitude g 
designated by numeral 513 in FIG. 30 from the maximum inner product detecting section 512, In the above- 
mentioned process, the inner product operation section 506. the maximum inner product detecting section 
512. the address counter 510 and the index latch 516 execute the same operation as that of the prior art. 
The dynamic code book RAM 528 as shown in FIG. 32 is constituted by a FIFO memory in first-in first-out 
form where writing or reading operation is performed in asynchronous state. 

Update is performed at any time according to the update procedure controlled by the dynamic code 
book control section 532. An example of the update procedure of the content of the dynamic code book 
RAM 528 will now be described based on an operation example of the dynamic code book control section 
532. The average value separated input vector x is inputted to the normalization circuit 529 and processed 
according to the following formulas, and analyzed into the normalization coefficient c designated by numeral 
530 in FIG. 30 and the normalized input X* designated by numeral 531 in FIG. 30. and then two parameters 
a and X* are supplied to the dynamic code book control section 532. 




X'j = Xj/a 

X- = (X",.X*2 X%] 

In the dynamic code book control section 532. using the normalized coefficient c and the correction 
amplitude g. the approximation d^ between the average value separated input vector x and the normalized 
output vector g • regenerated in amplitude at the decoded state is estimated according to the following 
formula, and the update procedure of the dynamic code book RAM 528 is adaptively controlled based on 
the magnitude of the approximation d^. 
ci^ - (X -gyi)^ 

= lil^ + - 2g(x. yj 

= a2 + g2.2g2(IZip = 1.(x,Xi) = g] 



= a2 - g2 



That IS. when the approximation d^ is larger than the allowable value 02 the write demand signal 533 Is 
made |1| and the normalized input vector X* is written in the dynamic code book RAM 528. and at the same 
time the normalized input vector 534 with Index to which predix is added so as to indicate the writing of the 
normalized input vector X* is outputted. On the other hand, when the approximation d^ is the allowable value 
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02 or less, the write demand signal 538 is made |0| and simply outputted. The write control signal 533 is 
transmitted to the first and second selectors 535c. and used to select the coded data transmitted 
corresponding to the update procedure of the dynamic code book RAM 528. That is. when the write 
demand signal 533 is |0|. since the update of the dynamic code book RAM 528 is not performed, the first 
selector supplies the correction amplitude g (numeral 513) outputted from the maximum inner product 
detecting section 512 to the amplitude coding device 515 in similar manner to the prior art. and the second 
selector 535b transmits the index 519 outputted from the index latch 516 as the vector data 541 to the 
coding data multiplexing section 520. When the write demand signal 533 Is |1|. the update of the dynamic 
code RAM is performed also at the receiving side, and at the same time the normalized output vector j^i at 
the decoded state is replaced by the normalized input vector )C (numeral 531), and in order to transmit the 
normalized coefficient a (numeral 530) obtained in the normalization processing, the first selector 535a 
supplies the normalized coefficient a to the amplitude coding device 515 and the second selector 535b 
supplies the normalized input vector 534 with index as the vector data 536 to the coding data multiplexing 
section 520. The amplitude coding device 515 performs similar operation to the prior art. 

Through the above-mentioned processing, the average value coded data 517. the amplitude coded data 
518 and the vector data 536 are multiplied in the coded data multiplexing section 520 according to the 
prescribed format, and then outputted as the decoded output data 521 . 

An operation example of the dynamic code book RAM 528 will be described referring to FIG. 32. The 
read control section 528d reads data on the address assigned by the address pointer i.e.. the normalized 
output vector and repeats the operation in sequence. 

When the write demand signal 535 is |1|. the write control section 528b writes the write data. i.e.. the 
normalized input vector X" onto the address assigned by the write address pointer. The address counter 
528a counts up the address by 1 at the write finishing point and resets the address to 0 when it becomes 
over the maximum value, and repeats the operation. When the above-mentioned operation is executed, the 
newest normalized input vector )C of the definite number determined by the memory capacity can be used 
as the normalized output vector the vector quantization. 

The vector quantization decoding operation in this embodiment will be described referring to FIG. 31 . 
The coded output data 521 are separated in the coding data demultiplexing section 522 according to the 
prescribed format into the average value coded data 517. the amplitude coded data 518 and the vector data 
536. 

The average value coded data 517 and the amplitude coded data 518 are decoded in similar manner to 
the prior art. and converted into the average value decoded value p (numeral 529 in FIG. 31) and the 
amplitude decoded value g (numeral 530 in FIG. 31). In the vector data decoding section, it is 
discriminated whether the separated vector data 541 is coincident with the prefix added to the normalization 
input vector or not. If coincident, the write demand signal 533 is made |1|, and the write demand signal 533 
and the normalized input vector X' (numeral 531 in FIG. 31) received subsequent to the prefix are outputted. 
If not coincident, the write demand signals 533 is made |0| and the vector data 536 is outputted as the index 
519. The fixed code book ROM 507 and the dynamic code book RAM 533 supply the normalized output 
vector Y\ (numeral 509 in FIG. 31) corresponding to the index 519 to the third selector 535c. Further when 
the write demand signal 533 is |1|. the normalized input vector X" (numeral 531 in FIG. 31) is written in the 
dynamic code book RAM 529. and the update of the dynamic code book RAM 528 similar to the coding 
operation is executed. In the third selector 535c. when the write demand signal 533 is \0\ the normalized 
output vector (numeral 509 in FIG. 31) is outputted. and when the write demand signal 533 is |1| the 
normalized input vector x (numeral 525 in FIG- 31) is outputted. The vector outputted from the third selector 
535c is multiplied by the amplitude decoded value 526, and then the average value decoded value 525 is 
added, thereby the decoded vector s (numeral 527 in FIG. 31) is obtained. 

in this embodiment, although the"average value separation and normalization vector quantization device 
is shown where the average value of the input vector is separated and the output vector is separated in the 
average value and normalized, similar effect can be obtained when the input vector is subjected to vector 
quantization directly, and the dynamic code book RAM is updated based on the vector quantization error. 

A seventh embodiment of the invention will be described referring to FIG. 35. 

FIG. 35 is a block constitution diagram of an image coding transmission system according to the 
invention. In FIG. 35. the side (g) indicates the transmitting side, and the side © indicates the receiving 
side. 

In FIG. 35. numei-al 601 designates an input buffer which inputs the digitized image signals and outputs 
them suitable to the coding section at the next stage, numeral 603 designates a frame memory which 
stores the image signals after coding and decoding before the present image signals by one frame, numeral 
602 designates a subtracter which carries out the subtraction between the output of the input buffer 601 and 
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the output of the frame memory 603, numeral 604 designates a quantization cQding device which gives the 
quantization and coding to the output of the frame memory 603. numeral 605 designates a quantization 
decoding device which decodes the signals after the quantization coding, numeral 606 designates an 
interframe adder which adds the quantization decoded output and the output of the frame memory 603. and 
writes the result to the frame memory 603. numeral 607 designates a variable length coding device which 
assigns the variable length code to the quantization coded output corresponding to the frequency of each 
code, numeral 608 designates a transmitting buffer which stores the variable length coding output, numeral 
609 designates a transmitting buffer control section which monitors the control of writing and reading in the 
transmitting buffer 608 and the storage amount of the transmitting buffer and then transmits the monitoring 
result to the input buffer 601. numeral 610 designates a dummy data adding section which adds the dummy 
data to the output of the transmitting buffer, numeral 616 designates a locate decoding capability 
information generation section which generates information indicating time capability of decoding process- 
ing at the local receiving side, numeral 617 designates a multiplexing section which multiplies the output of 
the dummy adding section by the local decoding capability information generated in the section 616. and 
numeral 611 designates a line interface section. 

Numeral 612 designates a line interface section on the receiving side numeral 619 designates a 
separate section which separates remote decoding capability information from the receiving data, numeral 
618 designates a transmitting operation control section which determines the local transmitting operation 
from the remote decoding capability information and transmits it to the transmitting side, numeral 613 
designates a dummy separate section which deletes the added dummy data, numeral 614 designates a 
variable length decoding section which decodes the variable length code, numeral 615 designates a 
receiving buffer which stores the signals after the variable length decoding, numeral 605' designates a 
quantization decoding section which gives the quantization decoding to the output of the receiving buffer 
615. numeral 603 designates a frame memory which stores the decoded image signals before the present 
image signals by one frame, and numeral 606' designates an interframe adder which adds the output of the 
quantization decoding section 605 and the output of the frame memory 603' and then writes the result to 
the frame memory 603 . 



The operation of the device will be described. 



The inputted image signals 701 are written to the input buffer 601. The input buffer performs writing and 
reading by the unit of the image frame, but it has the composition of double buffer because reading may be 
performed during writing. 

The coded and decoded image signals 702 before the present image signals by one frame are 
outputted from the frame memory 603. In the interframe subtracter 602. the interframe differential signals 
703 are obtained by subtracting between the present image signals 701 ' read from the image buffer and 
the image signals 702. The interframe differential signals 703 are encoded by the quantization coding 
device 604. and become the quantization coding signals 704. RG, 37 shows an example of characteristics 
of the quantization coding device. The quantization coded signals 704 are inputted in the variable length 
coding device 607. and transmitted into the variable length code 706 corresponding to the frequency of 
each coding signal. 

At the same time, the quantization coded signals 704 are inputted in the quantization decoding device 
605. and then are outputted as the coded and decoded differential, signals 705. FIG. 38 shows an example 
of characteristics of the quantization decoding device. 

The coded and decoded differential signals 705 are inputted together with the image signals 702 into 
the interframe adder 606. and become the coded and decoded image signals 702' and are written to the 
frame memory 603 for the coding to the next frame. 

On the other hand, the variable length codes 706 are inputted in the transmitting buffer 608 The 
transmitting buffer outputs the data in accordance with the requirement from the transmission line side after 
storing the vanable length codes over the definite amount, and has the composition of double buffer (buffer 
#1, buffer #2) because writing and reading must be performed at the same time. The transmitting buffer 
control section 609 controls writing and reading of the transmitting buffer. For example, when the buffer #1 
IS at wnting operation and the buffer #2 is at reading operation, the transmitting buffer control section 609 
monitors the storage amount of the buffer #1. and if the storage amount becomes more than the prescribed 
set value, the transmitting buffer control section 609 demands ceasing of output of the data to the input 
buffer 601 . 
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Receiving the demands, the input buffer 601 ceases the output of the data to the rear stage. The 
transmitting buffer control section 609 detects the pause of the input data to the transmitting buffer 608. and 
ceases writing to the buffer #1 and makes the situation of waiting for reading. The buffer #2 during reading 
ceases reading if the residual amount becomes less than the prescribed set value, and it waits for the buffer 
5 #1 to be in the situation of waiting for reading. When the buffer #1 is in the situation of waiting for reading, 
the buffer #2 and the buffer #1 are read out continuously. The buffer #2 is in the situation of waiting for 
writing when the residual amount becornes zero. 

When the buffer #2 is in the situation of waiting for writing, the transmitting buffer control section 609 
demands to start the output of the data to the input buffer 608. 
70 In this process, before the buffer #1 gets in the situation of waiting for reading, there becomes the 
situation that the transmitting buffer 608 cannot output any data. 

- The dummy data adding section 610 outputs the data with the dummy data adding thereto so as to 
continue the transmission of the data to the transmission line without break while the transmitting buffer 608 
cannot output the data. 

75 In the local decoding capability information generation section, the Information 707 indicating time 
capability of decoding processing at local receiving side, for example, information indicating time Tq 
required for processing one image frame is generated. 

This information Is multiplied In the multiplexing section 617 into that combined with the image dummy 
data. The signal after multiplexing Is converted in the line interface section 611 so that the electric level is 

20 matched to characteristics of the transmission line, and then outputted to the transmission line. 

At the receiving side, signal inputted through the transmission line is subjected to reverse conversion of 
the electric level In the line interface section 612, and information 707' indicating time capability of the 
remote decoding processing is separated from the signal in the separate section 619 and transmitted to the 
transmitting operation control section 618. and other data are transmitted to the dummy separate section 

25 613. In the dummy separate section 613, the dummy data added in the dummy adding section 610 are 
cleared thereby only the data about the Image are outputted. 

The output is processed In the variable length decoding section 614 by the reverse treatment with 
respect to that in the variable length coding section 607. and then inputted in the form of the quantization 
coded signals 704 into the receiving buffer 615. 

30 The receiving buffer has the composition of double buffer, because writing and reading are performed 
at the same time. In the receiving buffer, the stored data are variable in amount so as to take matching with 
respect to time between the signal speed inputted from the transmission line side and the speed of the 
image decoding section at the rear stage. 

For example, if the processing speed of the image decoding section at the next stage is low, the stored 

35 amount of the receiving buffer is increased. On the contrary. If the processing speed is high, the receiving 
buffer acts at the small stored amount. The quantization coded signals 704 are decoded by the 
quantization decoding device 605' and outputted as the coded and decoded differential signals 705 in 
similar manner to the transmitting side. The coded and decoded image signals 702 before the present 
decoding image by one frame are outputted from the frame memory 603 . and are added to the coded and 

40 decoded differential signals 705' in the interframe adder 606'. and the resulted signals are written as the 
coded and decoded image signals to the frame memory 603' and also outputted to outside. 

On the other hand, at the transmitting operation control section 618. based on the information 707 . 
discrimination is performed regarding what degree of the coding capability at the local transmitting side 
enables the decoding processing without overflowing of the receiving buffer at the remote station. 

45 For example, if time To' is required to decode one frame as the information 707 . command is issued 
so that the interval to transmit the code corresponding to the lead of each image frame from the 
transmitting buffer is always made To or more. 

Operation of the transmitting buffer control section 609 receiving the code will now be described in 
detail. 

50 FIG. 39 shows state of the transmitting buffer control section typically when the buffer #1 is at reading 
state and the buffer #2 finishes the writing and is waiting for reading. In usual, if the transmitting buffer 
stores data more than the prescribed set value (Th2 in FIG. 39) during writing, stoppage of data output is 
demanded to the input buffer 601 . In FIG. 39. the buffer #2 stops the writing at the storage amount M. 

On the other hand, reading from the transmitting buffer is performed at a burst in the N data unit, and 
55 when the residual amount of the buffer during reading becomes less than N, reading is performed only the 
buffer at reverse side is at waiting for reading, and reading is stopped at other cases. 

When command is issued from the transmitting operation control section 618 that transmitting inten/al 
of the code corresponding to the lead of the image frame is made To' or more, output of data 
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corresponding to the lead of the image frame from the transmitting buffer is checked. Once the correspond- 
ing data IS outputted. the timer is set to the time To' and supervision is performed so that next 
corresponding data is not outputted before the timer becomes time out. 

i,.f " "Js .recognized that the corresponding data exists in the N data to be subsequently transmitted 
before the time out, next reading is inhibited. h y c i ucu 

„ J'^V?"^^' ""^ '"'^"^"'"9 '0"9er the time of output stop command for data to the input 

buffer 601. Consequently, the image frame number which can be encoded per unit time is decreased 
h.JrLTJ^'T'^ ""^^^ ""u '° transmission line during read inhibiting of the transmitting 

buffer data of only .mage after the dummy data separation at the receiving side is intermittent in time 
thereby longer time can be used for the decoding processing at the receiving side 

Consequently, even at the image coding device having the receiving side of large To', since transmis- 
sion at the remote transmitting side is performed in matching with the local capability (limiting the capability 

Ts deter oratTr^^^ " 'IT'' '''•'"''^^ '^^^ """'^^^ ^"^"^^ the motion pictureTm age 

IS deteriorated, the device at the receiving side is made small size and low cost 

to fh'r I!i^^„T?H ""'""^"li". transmission image frame number at the transmitting side is drawn 

?om ? '"^t"''? '"'"""^ '""^ corresponding to the lead of the image 

Z rTnJZ T!!"^ " considerably lower level than 

l^ftn?rH 1 ««'°^«-'"«"«°"ed effect can be obtained when the image frame number 

outputted from the input buffer 601 per unit time is varied. 

Also in this embodiment, although the information 707 indicating the time capability of the decodina 

ZinrV"'.?" ':''" ""'"P''"'' °" transmission line^and transmitted. siLlar effect can be 

obtained when the information 707 is transmitted through other transmission line 

thP in™,rhIn^J°-*''® ^ """^^ described, in the motion compensation circuit, the average value of 

scene change, the frequency error signal is suppressed without increasing the hardware scale or the 

.rprSd.' " - picture t^it;-: 

*° '"^ '"^®"«°"- since the ON/OFF operation of each coding and decoding device is 
adaptively selected and changed, the generating amount of the coding information and me Sons^c^ed 
image quality can be adaptively controlled per frame unit in wide range reconstructed 

Further according to the invention, since the motion amount of the frame to be encoded hereafter is 
coZ^th coding control is performed, if the subiect is suddenly moved or stands s« I on the 

contrary, the interframe coding device without delayed control is obtained 

Further according to the invention, the dimension number of the vectors to be encoded is reduced and 

the l^Z''"""'"^^''" 1 1^^"''""' ^'"-^^ '"^^ ^^^^'^'^"^ processing is i^erfo^med at 

the encoding process of the second stage or later, the block size can be varied without increasina the 

Further according to the invention, since the vector quantization device is constituted in multiole staoes 

"e n^rtll'a^^ " "^'"^ ^^^^^^^ ^'^ '^'-^^ being el dilg^nS 

o^liH . f f constitution element, control range of the information amount is wide, and the picture 

TltsllnZTZ T°T.^ '^"^^ ''"^"«^^««" ^ «rst Lage does 

not adversely affect the coding at the second stage. 

Further according to the invention, since the code book of the vector quantization device is composed 
VJJrT '"''^ "'"^^ °' ^^^•^'■"9 possible at any time and a fixed code boTKe 

IZZ^^rUTT^'' ''"'"^ °" approximation between the input vector and the decoding vector wh^ 

r<fniS. T '^f °f *® approximation of the decoding vector can be suppressed with respect 

to special input vector bemg different in property from the output vector group stored in the fixed code 

*° invention, since the time capability of the decoding processina at the 
^ZZl^:^^"^"''*'^ '""9^ '^'^ '° the time intra?of dia 

J^r commun?!- " "^^^"^ °" '^^^ receiving side norr^L' 

TJSli^nT "2..''^ ""'"9 '^^^''^e °f cost and small size having tow 

decoding processing capability at the receiving side. ^ 



30 



0 288 963 



Claims 

1 . An average value predicting motion compensation operator, wherein input digital image signals are 
divided into blocks of prescribed size, and coding operation is performed to differential signals between the 
block of input signals and interframe predicting signals produced block by block, a circuit for producing a 
block of predicting signals is constituted by input signal blocks and previous frame blocks disposed on the 
same position on the previous frame as the input signal blocks, the blocks on the previous frame are given 
according to L sorts (L: positive integer) of displacement (hereinafter referred to as "motion vector"), and L 
blocks of the previous frame and average value of the input block is quantized into one of the M levels (M: 
positive integer), further are quantized average value is formed as the value of picture element within the 
block and total (L + 1 ) blocks are defined as predicting signals blocks (hereinafter referred to as "reference 
block"), whereby the block pattern matching between the input signal block and the reference blocks is 
estimated by prescribed measurement method and the block being most matched with the input signal 
block is picked up from the reference blocks, and the picked up block signal is outputted as the predicting 
signal block, and if the picked up block is selected from L blocks of the previous frame blocks, the index of 
the picked up block corresponding to the motion vector is outputted. and if the average value block is 
selected the index of the picked up block corresponding to the quantized level of the average value is 
outputted. 

2. An average value predicting motion compensation operator as set forth in claim 1. comprising: 

a differential absolute value operator which performs pixel by pixel differential absolute value process 
between a block of input signals and a block of signals disposed on the same position or near the position 
of the previous frame or a block of samples with the quantized average value as hereinafter described; 

an accumulator which performs distortion measure by accumulation of the differential absolute value 
and average value for each block by summalizing the input signals within the block; 

a quantizer which quantizes the average value into one of corresponding level of the matching 
distortion: 

a comparator which compares the matching distortion calculated with the accumulator between input 
signals and the signals on the same position or near the position on previous frame or with the quantized 
average value, and outputs the block of signals on the previous frame to give the minimum distortion or 
index corresponding to the quantization average value; and 

a selector which supplies the differential absolute value between the block of input signals and the 
blocks of signals on the previous frame or the block of input signal to the accumulator. 

3. An average value predicting motion compensation operator as set forth in claim 1 or claim 2. wherein 
in place of the differential absolute value operator, a differential square value operator is used, and 
difference square value of each picture element is calculated between the input signals and the reference 
blocks. 

4. An average value predicting motion compensation operator as set forth in claim 1 or claim 2, wherein 
in the accumulator, the matching distortion of each reference block is supplied with different weighting 
function thereby the specific reference block as that giving the minimum distortion tends to be selected or 
not. 

5. An image signal progressive build-up encoder/decoder wherein in case of one input image signal 
system, the input signal system is performed high efficiently coding and decoding, and obtained re- 
constructed image signal system is delayed by one frame, and the residual signal system between the 
input image signal system and the delayed signal system is again performed high efficiently coding and 
decoding frame by frame and operation is repeatedly executed thereby high quality image is performed 
progressive build-up in time progresses, said encoder/decoder comprising: 

an average value encoder/decoder which calculates average value within block of residual signal 
vectors obtained by forming the block of the residual signal system per lattice-shaped m x n (m. n: positive 
integer) sample, and performs high efficiently coding of the average value; 

a normalized vector quantization encoder/decoder which utilizes the residual signal vector as input 
vector and subtracts the average value from each element of the input vector and obtains the normalized 
output vector having the maximum inner product value to the input vector amount a set of normalized 
output vectors with average value 0, amplitude 1 generated so that total of distortion is minimized based on 
the distribution of normalized input vectors of which amplitude becomes 1. and obtains index to indicate the 
normalized output vector, and also performs high efficiently coding and decoding of the amplitude gain of 
the input vector given by the maximum inner product value, and the decoded amplitude gain is multiplied 
by the detected normalized output vector thereby the amplitude reconstructed output vector can be 
obtained; 
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a sample value encoder/decoder which performs high efficiently coding and decoding of m x n block of 
samples in the residual signal vector sample by sample; 

a switch which adaptively controls ON/OFF operation of the average value encoder-decoder, the 
normalized vector quantization encoder/decoder and the sample value encoder/decoder based on the 
control signal frame by frame: 

a vector reconstructor which selects adaptively the decoded average value, the decoded residual signal 
vector by adding the decoded average value to the amplitude reconstructed output vector, and the decoded 
sample value based on the hereinafter described frame by frame control signal, ant then outputs them as 
the decoded vector; and 

a coding controller which generates the control signal and enables the adaptive control operation of the 
switch, each encoder/decoder and the vector reconstructor corresponding to the number of coded samples 
each frame. 

6. An image signal progressive build-up encoder/decoder as set forth in claim 5. wherein in the coding 
controller, at the first coding stage, only the average value encoder/decoder are turned on. and rough image 

IS is reconstructed by the decoded vector which all m x n samples are substituted by the decoded average 
value, and at the second coding stage, the average value encoder/decoder and the normalized vector 
quantization encoder/decoder are turned on. and the decoded vector substituted by the decoded residual 
signal vector is obtained, and the image of which quality is better than that of the first stage can be built up, 
and at the third coding stage or later, only the sample value encode/decoder Is turned on. the decoding 
vector comprising the decoding value of m x n pixels of sample value is obtained, and the image of which 
quality is better than that of the second stage can be built up. 

7. An image signal progressive build-up encoder/decoder as set forth in claim 5 or claim 6. wherein in 
the average value encoder/decoder, the normalized vector quantization encoder/decoder and the sample 
value encoder/decoder, a set of different coding and decoding control modes corresponding to various 
encoded information generation rate of each coding stage are prepared, and based on the total encoded 
information generation rate of one frame by frame coding stage and the number of the stage, the coding 
and decoding control mode, operation of the switch and the vector reconstructor are adaptively selected 
and controlled frame by frame at the subsequent coding stage. 

8. An image signal progressive build-up encoder/decoder as set forth in any of claim 5. 6. 7. wherein 
square-root of the mean square error of each sample between the residual signal vector and the decoded 
vector outputted from the vector reconstructor is calculated as the en-or amplitude value, and based on the 
average of the error amplitude value during one frame period and the number of coding stage, the coding 
and decoding control mode and operation of the switch and the vector reconstructor are adaptively selected 
and controlled frame by frame at the subsequent coding stage. 

9. An interframe motion image encoder wherein a first frame memory which can store the motion image 
signals at least by one frame is provided. Interframe predicting signal is obtained utilizing the first frame 
memory, and the interframe prediction error signals are performed high efficiently coding and decoding and 
the encoded data are transmitted, and at the same time the decoded image signals are written in the first 
frame memory and updated for the interframe prediction of the subsequent frame or later, said encoder 

40 comprising: 

a discriminator which evaluates approximation of the interframe predicting signal to the input motion 
image signals to be coded, and then compares the approximation with the prescribed threshold value, and 
In the case of the large approximation, it generates the signal indicating that the interframe predicting 
signals are treated as the decoded signal; 

an encoder and decoder which performs coding and decoding operation in the case of the small 
approximation; 

a second frame memory which can store the input motion Image signals at least by one frame, and 
memorises the input signals before coding operation; 

an estimator which performs subtraction of the image signals of the previous frame read from the 
second frame memory and the input image signal, and then performs integration frame by frame and 
obtains the estimation value of the information generation amount of the current frame; and 

a coding controller which judges the threshold value of the current coding frame corresponding to the 
corrected motion amount in order to smooth the information generation rate based on the method- the 
motion amount is estimated from the threshold value and the information generation amount of the previous 
coding frame, and then the motion amount is corrected by the estimated information generation amount of 
the current coding frame outputted from the estimator according to estimate the motion amount of the 
current coding frame, and the corrected motion amount is determined. 
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10. An image signal progressive bui!d-up encoder wherein to same one input image frame the input 
signals are performed high efficiently coding and decoding and reconstructed image signals are delayed by 
one frame period, and the residual signals between the input image signals and the delayed signals are 
performed high efficiently coding and decoding frame by frame respectively and operation is repeatedly 

5 performed thereby high quality and resolution image is built up progressively as time progresses, said 
encoder comprising: 

a vector/sub vector transformer which forms lattice-shaped am sample x bn line (a. b. m, n: natural 
number, and am = a x m, and bn = b x n) residua! signals into an L-dimensional (L = am x bn) vector, 
and forms lattice-shaped m x n average values calculated within the blocks of a sample x b line residual 
10 signals respectively into a K-dimensional (K = m x n) subvector; 

an average value encoder and decoder which performs high efficiently coding and decoding of the 
arithmetic means of the sample within the residual signal subvector; 

K-dlmension normalized vector quantization encoder and decoder which treats the residual signal 
subvector as K-dimension input vector, and performs vector quantization of the input vector through the 
fs inner product operation of K dimensions into K-dimension normalized output vector of average value 0 and 
amplitude 1, and performs high efficiently coding and decoding of the amplitude gain of the residual signal 
subvector given by the inner product value between normalized output vector and the input vector; 

a subvector/vector de-transformer which arranges samples within the decoded K-dimenslon residual 
signal subvector obtained by multiplying the normalized output vector and the decoded amplitude gain, and 
20 each element of the K-dimension amplitude reconstructed output vector corresponding to lattice-shaped m 
sample x n line subvector is added to the decoded average value, thereby performs interpolation of the 
decoded residual signal vector having L dimensions; and performs decrease size of the lattice-shaped block 
of the residual signals step by step and to execute the coding and decoding operation repeatedly. 

11. An image signals progressive build-up encoder as set forth in claim 10, wherein at first coding 
25 stage, the input image signals are combined by lattice-shaped m sample x n line and average value within 

the block is treated as one sample, and the samples are further combined In lattice-shaped m x n samples 
into K-dimension input vector and K-dimension mean separated and normalized vector quantization is 
performed for the K-dimensioii input vector, and at the subsequent coding stage, the K-dimension mean 
separated and normalized vector quantization is performed again respectively by combination of the lattice- 
30 shaped m sample x n line the residual signals thereby hierarchical coding and decoding for each block can 
be performed. 

12. An image signal progressive build-up encoder as set forth in claim 10 or claim 11. wherein at the 
subsequent coding stage, the square means of the sample value within the block by combination of the 
lattice-shaped m sample x n line residual signals is compared with the threshold value, and block by block 

35 conditional replenishment is executed for coding and decoding of only the block having the square means 
value larger than the threshold value, and binary informations indicating the result of the threshold 
comparison is performed high efficiently coding and decoding. 

13. An interframe vector quantizer in hierarchical multi-stage structure, comprising: 
a frame memory which can store image signals of at least one frame 

40 a subtracter which subtracts interframe predictive signals from input nootion image signals to form 

interframe differential signals; 

average value and amplitude operation circuit which forms the interframe differential signals obtained 
by the subtracter into the blocks with horizontal m picture elements by vertical n lines (m. n being positive 
integers) and calculates the first average value and amplitude; 
45 a block discrimination circuit of the first stage which compares the first average value and amplitude 

with the threshold value of the first stage 

an average value separation and normalization circuit of the first stage which forms the first average 
values into blocks of horizontal m by vertical n corresponding spatially to m x n blocks of the interframe 
differential signals and calculates second average value and amplitude and subtracts the second average 
50 value from the block of the first average values; 

a code table of the first stage which stores a set of output vectors suited for the distribution of the input 
vector assuming that the block of the first average values is the input vector of the first stage 

a distortion operation circuit of the first stage which calculates distortion between the input vector of the 
first stage and the output vector; 
55 a minimum distortion detecting circuit which detects the optimum output vector of the first stage which 

gives the minimum distortion and determines the index of the optimum output vector of the first stage; 

a decoding circuit of the first stage which multiplies the optimum output vector of the first stage by the 
second amplitude and adds the second average value thereby obtains the decoded vector of the first stage; 
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a subtracter which subtracts the decoded vector of the first stage from the interframe differential signal 
and obtains the error signal; 

an average value separation and normalization circuit of the next stage which forms the error signals 
into the blocks with the horizontal m elements by vertical n lines so that the blocks of the error signals 
corresponding spatially to the blocks of the interframe differential signals formed by the average value and 
amplitude operation circuit of the first-stage, and calculates the third average values and amplitude 
regarding blocks except for the block where the first average value and the amplitude are less than the 
threshold value of the first stage, and subtracts the third average value from the block of error signals and 
normalizes at the third amplitude; 

a block discrimination circuit of the next stage which compares the third average value and amplitude 
with the threshold value of the next stage 

a code table of the next stage which stores a set of output vectors suited for the distribution of the 
input vectors of the next stage assuming that the blocks of the error signals except for ones where the third 
average value and amplitude are less than the threshold value of the next stage in the block discrimination 
circuit of the second stage; 

a distortion operation circuit of the next stage which calculates distortion distance between the input 
vector of the next stage and the output vector; 

a minimum distortion detecting circuit of the next stage which detects the optimum output vector of the 
next stage which gives the minimum distortion among the distortion calculated by the distortion operation 
circuit of the next stage and determines the index of the optimum output vector; 

a decoding circuit of the next stage which multiplies the optimum output vector of the next stage by the 
third amplitude and adds the third average value thereby obtains the decoded vector of the next stage; 

an adder which adds the decoded vector of the first stage and the decoded vector of the next stage 
and forms the decoded interframe differential signals; 

an adder which adds the decoded interframe differential signals to .the interframe predictive signals and 
obtains the decoded image signal; 

a variable length coding section which operates variable length coding of the second and third average 
value and amplitude and the index of the optimum output vector of the first stage and the next stage and 
the result of the block discrimination circuit of the first stage and the next stage and 

a buffer which temporarily stores data subjected to variable length coding and performs smoothing of 
the amount of Information to be transmitted, 

wherein when the first average value and amplitude are detected to be less than the threshold value of 
the first stage by the block discrimination circuit of the first stage, and the decoded vector at the first stage 
and the corresponding blocks of the next stage are assumed as zero vectors, when the third average value 
and amplitude are less than the threshold value of the next stage the decoded vector of the next is 
assumed as zero vector, and threshold value at the first stage and the next stage is hierarchically controlled 
when the storage amount in the buffer is supposed as at least one of the control condition. 

14. An interframe vector quantizer as set forth in claim 13. wherein when distortion distance between 
input vector of the first stage and output vector read from the code book of the first stage is determined in 
the distortion operation circuit of the first stage, element of the input vector of the first stage corresponding 
to the block having the first average value and amplitude less than the threshold value in comparison in the 
block discrimination circuit of the first stage is ignored in process of the distortion calculation. 

15. An interframe vector quantizer as set forth in claim 13, wherein before the third average value and 
amplitude are subject to variable length coding in the variable length coding section, a quantizer of average 
value and amplitude of subsequent stage having a plurality of quantization characteristics is previously 
provided, and the plurality of quantization characteristics are adaptively changed by the second amplitude 
obtained in the average value separation and normalization circuit of the first stage. 

16. An interframe vector quantizer as set forth in claim 13, wherein plural sets of output vectors having 
different characteristics are stored in the code table of the next stage, and the plurality of quantizing 
characteristics are adaptively changed by the second amplitude obtained In the average value separation 
and normalization circuit of the first stage. 

17. A dynamic vector quantizer provided with a coding section comprising; 

an average value separation circuit which separates the average value within a block from input vectors 
formed with every k samples (k being integer of two or more) of input signal; 

an average value coding circuit which encodes the average value; 
a normalization circuit which normalizes the average value separated Input vector obtained through 
average value separation by the average value separation circuit according to the amplitude of the inout 
vector; ^ 
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a fixed code book which stores a plurality of normalized output vectors suited for the distribution of the 
normalized input vectors; 

a dynamic code book which stores the plurality of normalized input vectors supposing them as 
normalized output vectors, the stored content being updated: 
5 an inner product operation section which calculates inner product value between the average value 

separated input vector and a plurality of normalized output vectors stored in the fixed code book and the 
dynamic code book; 

a maximum inner product detecting section for finding maximum inner product value among a plurality 
of inner product values calculated by the inner product operation section; 
10 an amplitude coding circuit which encodes either the maximum inner product value or the normalization 
coefficient; 

a dynamic code book control section which calculates a degree of approximation between the input 
vector and the decoded vector after vector quantization of the input vector using the maximum inner 
product value and the normalization coefficient, and controls the updating operation of the dynamic code 

T5 book based on comparison result of the degree of approximation and threshold value previously set; 

a coded data multiplexing section which multiplexes either discrimination code relating to the update 
procedure, the output data of the average value coding circuit, the output data of the amplitude coding 
circuit and the maximum inner product value or normalized output vector and the discrimination code is 
attached according to the prescribed format, and then transmits it; 

20 means which calculates the degree of approximation with the normalization coefficient and the 

maximum inner product value and selects the maximum inner product value as input signal to the amplitude 
coding circuit when the degree of approximation is larger than the threshold value, and defines the input 
signal to the coding data multiplexing section with the discrimination code, of the output data of the average 
value coding circuit, the output data of the amplitude coding circuit and the normalized output vector; and 

25 means which replaces the oldest normalized input vector stored in the dynamic code book 

corresponding to the input vector with the normalized input vector thereby executes the update operation 
when the degree of approximation is less than the threshold value, and selects the normalization coefficient 
as input signal to the amplitude coding circuit, and further defines the input signal to the coding data 
multiplexing section with the normalized input vector and the output data of the average value coding 

30 circuit, the output data of the amplitude coding circuit and the discrimination symbol indicating that the 
updating operation has been done thereto, 
decoding section comprising: 

a coded data demultiplexing section which separates the coded data transmitted from the coding 
section into the average value coded data, the amplitude coded data and the discrimination symbol 

35 according to the prescribed format; 

an average value decoding circuit which decodes the average value coded data 
an amplitude decoding circuit which decodes the amplitude coded data; 
a fixed code book and a dynamic code book corresponding to the fixed code book and the dynamic code 
book at the side of the coding section respectively; 

40 means which reads the normalized output vector on the address indicated by the discrimination symbol 
from the fixed code book or the dynamic code book when the discrimination symbol indicates the 
normalized output vector, and performs prescribed operation based on the normalized output vector, and 
decoded amplitude value outputted from the amplitude decoding circuit, and the decoded average value 
outputted from the average value decoding circuit thereby obtains the decoded vector to the input vector; 

45 and 

means which replaces the oldest vector stored in the dynamic code book with the normalized input 
vector received following the discrimination symbol in the case that the discrimination symbol indicates the 
update operation thereby executes similar to the update in the coding section, and performs prescribed 
operation of the normalized input vector based on the decoded amplitude value and decoded average value 
50 thereby obtains the decoded vector to the input vector. 

18. A dynamic vector quantizer as set forth in claim 17. wherein in the coding section, a plurality of 
normalized output vectors within the fixed code book are arranged in tree structure in step per 2" (n: natural 
number), and a normalized output vector giving the maximum inner product value to the input vector is 
selected among 2" pieces of the normalized output vectors in sequence from upper step of the tree 

55 structure towards lower step and tree searching method is used. 

19. A dynamic vector quantizer as set forth in claim* 17. wherein the normalization circuit performs 
normalization using the root of the sum of the squared average value-separated-input vector as the 
normalization coefficient. 
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20. A dynamic vector quantizer as set forth in claim 17. wherein the fixed code book stores a plurality 
0 normalized output vectors with average value zero and magnitude 1 determined depending on the 
statistical characteristics of plural normalized input vectors. 

21. A dynamic vector quantizer as set forth in claim 27. wherein the degree of approximation between 

nZJ,T\ J '^^""'^^'^ quantization is estimated using the squared 

normalization coefficient and the squared maximum inner product value. 

3S set forth in claim 17. wherein the discrimination symbol indicates the 
H»^nH?H ?f w . -^^^^^sPO^ding to the output vector, the normalized output vector Is multiplied by the 
decoded amplitude value and the product is added to the decoded average value 

th« ^LJ/'^"^""?- ^^T' ^ set forth in claim 17. wherein the discrimination symbol indicates that 

^IITh ^^TT". ^ 1^^" '"P"« is multiplied by the decoded amplitude 

value and the product is added to the decoded average value. 

24. An image coding transmission system wherein at the transmitting side digitalized imaqe signal is 

'"V" ^"'^ ^* '''' transmitted signal is dec oded nd 

fh« H^f H "^"f • ^* '"^ transmitting side of one station the information indicating time capability of 

the decoding process of the station is transmitted, and at the receiving side the transmitted infolaLn 
indicating time capability of the decoding process of the opposite station is detected and he TcSno 
processing speed of the transmitting side may be controlled based on the infomiation ^ 

25. An image coding transmission system as set forth in claim 24. wherein based on the Information 
md.cat.ng t.me capability of the decoding process of the opposite station, the number Mirage frrmes to ^ 
coded per unit time in the self station may be controlled. 

26 An image coding transmission system as set forth in claim 24, wherein based on information 

ullTnT^ '^"f °' ^""^"^ °' °PP°^'t^ station, the number of image frames to be 

transmitted per unit time in the self station may be controlled. 

innvi!- '^I- "^^^^ '"^ transmission system as set forth in claim 24. wherein based on information 
^^ZZVT °' °* °PP°««« station, minimum value of tir^e ^5^.31 

StSoili. ' corresponding to the lead of each image frame at the self sTati'n may 
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